REDBetter-crawler
REDBetter-crawler copied to clipboard
Getting session cookie failed errors.
I went into my chrome cookie settings and copied the session cookie from redacted. There doesn't seem to be any documentation anyhwere on where im even supposed to get the session cookie so this was my best guess. I'm getting session cookie failed and too many redirect errors when running redbetter.
After playing around with it, I found that the cookie value needs to be url-encoded. Not sure why the requests library doesn't automatically do this (i'm on python2).
The easiest way to get the urlencoded cookie is to open DevTools Network tab, log a request to the site, and inspect the raw headers. The cookie value in the raw headers will be urlencoded already. (Cookie: session=blahblahblah%3D%3D)