colly
colly copied to clipboard
Switch proxy and revisit on error?
Hi I got a use-case, when my proxy-ip got banned because of a big number of req/hour.. I want to remove 1 banned proxy-ip and set a new one... how can I do it with colly?
You have to do it yourself to count these failures.
colly's design is not like scrapy, not good
scrapy is very easy to handle everythings
I also want to know how to achieve this function.