crawlee
crawlee copied to clipboard
Improve Session Management guide.
The session management guide shows how to set up SessionPool, but does not really tell the user how to use it for common use cases, like using a single IP until it breaks.
There's a mention about IP rotation in Proxy management, but it's not detailed enough.
please do this. I don't know how to bring my own cookies to the crawlers session management.
Is it through createSessionFunction option? or I need to set the cookie at requestHandler each time?
@souravjain540 probably worth looking into with 11 upvotes