OF-Scraper icon indicating copy to clipboard operation
OF-Scraper copied to clipboard
verified publisher icon datawhores

# Downloads stall out

Open OpenFieldsOfOz opened this issue 7 months ago • 3 comments

After running for some time, downloads stall out. I see no CPU or network activity from the tool. Leaving it for long periods of time does nothing. Does anyone else have this issue?

OpenFieldsOfOz avatar May 09 '25 22:05 OpenFieldsOfOz

How is anyone supposed to help if you don't provide anything helpful. Like what version number of ofscraper are you using, what version of python do you have, can you share any logs or screenshots of the issue you are having, can you share your config.json?

cjb900 avatar May 09 '25 22:05 cjb900

I've attached a log here

ofscraper_main_profile_2025-05-09.log

OpenFieldsOfOz avatar May 09 '25 23:05 OpenFieldsOfOz

I had switched to httpx. Switching back to aio and following the instructions here to fixed my issue with stalled downloads.

OpenFieldsOfOz avatar May 12 '25 05:05 OpenFieldsOfOz

3.13.dev6 should solve an issue that users where having with downloading on with httpx

datawhores avatar May 30 '25 13:05 datawhores

Closing this as the user has found a solution that works

datawhores avatar May 30 '25 14:05 datawhores