docling
docling copied to clipboard
implement retry strategy for remote calls
Hi,
when for example sending images for description to remote API, it would be beneficial to add a retry strategy in the underlying requests calls, i.e.:
import requests
from requests.adapters import HTTPAdapter, Retry
s = requests.Session()
retries = Retry(total=5,
backoff_factor=0.1,
status_forcelist=[ 500, 502, 503, 504 ])
s.mount('http://', HTTPAdapter(max_retries=retries))
s.get('http://httpstat.us/500')
This way we could solve various errors that might happen during these calls, such as:
"Requests to the ChatCompletions_Create Operation under Azure OpenAI API have exceeded token rate limit of your current AIServices S0 pricing tier. Please retry after 11 seconds.