vijaykurhade

it keeps checking my proxy servers Dead or not than actually doing its job of scraping data

1

Followed instructions on usage page and tried my scrapy crawler. it keeps checking my proxy servers Dead or not than actually doing its job of scraping data How do i...

my proxies.txt file looks like http://username:password@IP:Port http://username:password@IP1:Port ......... there are over 100 dedicated proxies(all are active) but using above library with PROXY_LIST = 'proxies.txt' all I get All proxies are...

how to use proxies.txt

1

I have list of 250 odd proxies and want to set them like PROXIES_LIST but I guess scrapy-proxy-pool dosent work in that fashion like plain python. How can i make...