scrapy-playwright icon indicating copy to clipboard operation
scrapy-playwright copied to clipboard

Published 20 hours ago • verified publisher icon scrapy-plugins

How to recreate a context (browser) if it was closed remotely

Open Schtil opened this issue 1 year ago • 0 comments

Greetings! I am using scrapy-playwright along with Selenium Grid browser cluster. And if the crawling process by the spider is delayed - the cluster can forcibly close the session and context remotely. And at the moment scrapy-playwright just gives an error and stops the crawling process. How can I get it to create a new context when it receives an error?

Schtil avatar Mar 31 '23 16:03 Schtil