As discussed, Impit is growing adoption among both internal and external users of Crawlee. Currently used got-scraping cannot compete with Impit in the antiblocking performance anymore.
Since we're planning to use Impit as the default HTTP client in Crawlee v4, we could try soft-launching it by injecting ImpitHttpClient into the templates (even now in v3).
As discussed, Impit is growing adoption among both internal and external users of Crawlee. Currently used
got-scrapingcannot compete withImpitin the antiblocking performance anymore.Since we're planning to use Impit as the default HTTP client in Crawlee v4, we could try soft-launching it by injecting
ImpitHttpClientinto the templates (even now in v3).