warn-scraper icon indicating copy to clipboard operation
warn-scraper copied to clipboard

GA scraper needs explicit timeouts

Open stucka opened this issue 2 years ago • 0 comments

Probably most of the scrapers do, but: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='www.tcsg.edu', port=443): Max retries exceeded with url: /warn-public-view/ (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa557ff2f70>: Failed to establish a new connection: [Errno 110] Connection timed out'))

Shut down after six hours, looks like

stucka avatar Oct 25 '23 21:10 stucka