bing_image_downloader icon indicating copy to clipboard operation
bing_image_downloader copied to clipboard

Error protection mode

Open Thomasasia opened this issue 3 years ago • 0 comments
trafficstars

I added an additional argument, giving functionality to an "error protection mode". The advantage of this mode is that it makes the program much more robust in its error handling. Url Errors could cause problems or occasional make the program crash. These errors are from things like disconnects, such as when Bing refuses your request. These sort of errors are often random, and will occur server-side.

When you're trying to download a very large number of images, such as for machine learning projects, that can cause some obvious issues. Thus, I made the error protection mode wait for an appropriate amount of time and retry, while ensuring the total retry wait time doesn't wait longer than the timeout variable.

I've been testing it out, and this solution works pretty well!

Thomasasia avatar Apr 11 '22 22:04 Thomasasia