scrapy-crawl-once
scrapy-crawl-once copied to clipboard
add CRAWL_ONCE_RESET setting
Aimed to fix #4 Added setting similar to DELTAFETCH_RESET
Expected usage:
in settings.py:
CRAWL_ONCE_RESET = True
or in terminal:
scrapy crawl spider_name -a crawl_once_reset=True
If True,
SqliteDict.clear()
is called on the db