crawlee-python icon indicating copy to clipboard operation
crawlee-python copied to clipboard

`CurlImpersonateHttpClient` warning on Windows

Open janbuchar opened this issue 5 months ago • 0 comments

Using the CurlImpersonateHttpClient adds this warning message upon program start, which doesn't seem to be fixed if I add in the command that it asks for

    asyncio.set_event_loop_policy(WindowsSelectorEventLoopPolicy())
    await crawler.run(["https://www.mtggoldfish.com/metagame/modern#paper"])
.venv\Lib\site-packages\curl_cffi\aio.py:137: RuntimeWarning:
    Proactor event loop does not implement add_reader family of methods required.
    Registering an additional selector thread for add_reader support.
    To avoid this warning use:
        asyncio.set_event_loop_policy(WindowsSelectorEventLoopPolicy())

Originally posted by @MrTyton in https://github.com/apify/crawlee-python/issues/486#issuecomment-2325385889

janbuchar avatar Sep 03 '24 08:09 janbuchar