seanmonstar
Feature request: Proxy management
The entire boilerplate to build an efficient proxy cycling mechanism for applications such as web scraping and others is always a very tedious one and there aren't many good solutions out there for easy integration with reqwest.
It would be a great addition, in my opinion, to include a built-in option for providing a collection of proxies and a small infrastructure for automatic management that cycles through them, drops after unsuccessful attempts, and maximizes the cycling of proxies.
Something resembling a proxy management system is already implemented in reqwest but it instead attempts to reuse the same one until it becomes "bad". I propose a small addition to this by allowing the option to instead cycle through them trying to maximize the usage of different proxies in each request instead of trying to use the same one. This is very useful in situations where we may want to create many connections using different proxies each time. Alongside this, other features such as blacklisting proxies with X number of failed attempts and other "easy but cumbersome-to-implement" strategies for basic proxy management could be implemented.
I don't think I have enough experience with rust but I offer myself to help with whatever I can.
Do you guys think this idea would fit the philosophy of your library?
