datawhores
Cleaning temp files
I searched the documentation and didn't see anything about this, so I'll ask here.
Every time I start the script, there's a "cleaning temp files" operation that runs, and not only that, it takes like, over 5 minutes to complete. Is this normal? Can it be bypassed?
You can turn on auto resume in the config
auto_resume
If you want to clean up .part files but don't want the large cleanup at the end and beginning of the script try getting a new commit and setting
BATCH_TEMPFILE_CLEANUP
as false in custom_values in the config
The large cleanup is now opt in As long as you don't interupt the script it should not be needed
Just updated to the latest version (pip install ofscraper --upgrade) and am still getting "[paths.temp_cleanup:44] Cleaning up temp files" at the beginning of the script. Is there something I need to change/add to the config file?
No it won't work until I upgrade the version on pip until then you can just set
BATCH_TEMPFILE_CLEANUP as false in custom_values