Rotate through all given proxies before letting yagoogle handle the waiting

[sporetec]

This rework lets pagodo:

• Have a new flag and argument to divide the wanted wait time by the amount of unblocked proxies and recalculate on a proxy being blocked. Default behavior stays unchanged
• Rotate through all given proxies before letting yagoogle handle the 429 to reduce execution time

[opsdisk]

Thanks for submitting a PR @sporetec! Just a heads up, it may be a week or two until I can take a good look at it.

[opsdisk]

Hey @sporetec - haven't forgotten about this! Hoping to dig into the PR soon.

[opsdisk]

@sporetec - Would it be possible to tackle this feature first?

"Rotate through all given proxies before letting yagoogle handle the 429 to reduce execution time"

To be clear, you don't want the script to automatically go to sleep if an HTTP 429 is detected, especially if there are other proxies that can be tried?

As it is currently written, since yagooglesearch_manages_http_429s is not set during the instantiation of a yagooglesearch.SearchClient object (like is done here https://github.com/opsdisk/pagodo/blob/master/pagodo.py#L200), it defaults to True https://github.com/opsdisk/yagooglesearch/blob/master/yagooglesearch/init.py#L82

[senf666]

would be good to get this into master