scrapy-dotpersistence
scrapy-dotpersistence copied to clipboard
A scrapy extension to sync `.scrapy` folder to an S3 bucket
…n role instead of user role)
The latest version on PyPi is Aug 4, 2016 (https://pypi.org/project/scrapy-dotpersistence/#history). The latest commit into the master branch on GitHub is Aug, 22 2019.
README.rst says that the bucket, access keys etc. can be configured in settings.py, but this doesn't seem to work in practice: whatever the value of the given settings in settings.py,...