Mike Stucka
Mike Stucka
This screams for a reasonable specified time out with a retry function. This held up the rest of the workflow for about 15 minutes, too. ``` 2023-10-04 23:07:58,537 - warn.platforms.job_center.site...
Michigan's scraper appears to be fetching and parsing 16 years of archival data, which ... is not going to change. We should the PDFs, ZIP 'em up, archive them, then...
Worth looking to see what happened here: LEGACY SUPPLY CHAIN S Notice date: 2023-10-29 Location: eCrvhiacrele IsIt o("nLegacy"), SC Jobs: 47
The Ohio scraper has been rebuilt and most of the archives were consolidated into a single CSV for download. However, the CSV that Big Local News had been hosting contained...
Bot sent through something with no state postal code, even CHARTER COMMUNICATIONS LLC - CENTRAL REGION Notice date: 2023-07-26 FALLON HEALTH WEINBERG, INC. - WESTERN REGION Notice date: 2023-07-20
Wisconsin scraper uses a Google Sheet with one of our API keys to get the JSON, like their page uses their API key. Both keys then become potentially subject to...
This may be worth noting in the README ... ? *npm install* in a regular Windows command prompt will fail, as git-hooks is trying to build a symlink. Running *npm...
In both Windows and Linux, using regular command line; command line through `pipenv run civic-scraper`, and in Jupyter using Runner: I get the same TypeError when trying to scrape a...
The `pipenv` configuration specifies `Python 3.7`, but that stopped getting security fixes in June 2023. I've seen some compatibility problems trying to test on `Python 3.12.` It might be easy...