crawlee-python icon indicating copy to clipboard operation
crawlee-python copied to clipboard

Curl Cffi Client

Open siddiqkaithodu opened this issue 7 months ago • 1 comments

Since we use HTTPX , Isn't better to use curl_cffi instead or use it an optional client that switches when the HTTPX gets defeated in the AntiBot war.

I am thinking about intelligently switching between multiple http clients. (The same as of proxy rotation)

siddiqkaithodu avatar Jul 12 '24 12:07 siddiqkaithodu