scrapy-rotating-proxies
scrapy-rotating-proxies copied to clipboard
it keeps checking my proxy servers Dead or not than actually doing its job of scraping data
Followed instructions on usage page and tried my scrapy crawler. it keeps checking my proxy servers Dead or not than actually doing its job of scraping data
How do i fix it?
Same here. Sometimes take few seconds for checking... can that be disabled somewhere?