scrapy-splash icon indicating copy to clipboard operation
scrapy-splash copied to clipboard

Website Detects "Browser Blocks Cookies" When Rendered Using Splash

Open roberthng opened this issue 4 years ago • 0 comments

Hi all, I'm quite new on splash and currently try to scrape web pages that require login. I use splash because it can render javascript which is used by the website I'm trying to scrape. Whenever i try to render the website on splash the site appears to detect that the browser blocks cookies.

website: capitaliq.com image

Does anybody know how to work around with this issue? I tried using splash:init_cookies(splash.args.cookies) but it appears to not be the solution and instead returns an error. Many thanks.

roberthng avatar Mar 26 '21 08:03 roberthng