Django-link-archive

Django-link-archive copied to clipboard

Crawlee uses file system to store some data. This might lead to errors if multiple processes use storage / crawlee os.environ["CRAWLEE_STORAGE_DIR"] = "./storage/{}".format(os.getpid()) I changed it so new instance of...

rumca-js

Verify if we can use parts of https://github.com/neonwatty/ytdatakit repo code

1

https://github.com/neonwatty/ytdatakit - It is convenient to call yt-dlp as process (interface is stable, well defined) - might be slower - we could test speed of said solution

rumca-js

User passes PageOptions.ssl_verify (which is default). We want the configuration to also set ssl_verify, if user does not set it manually.

rumca-js

rumca-js

rumca-js

rumca-js

Args? time when to execute?

rumca-js

rumca-js

rumca-js

rumca-js