scrapy-crawl-once icon indicating copy to clipboard operation
scrapy-crawl-once copied to clipboard

add CRAWL_ONCE_RESET setting

Open SteveSmirnoff opened this issue 3 years ago • 0 comments

Aimed to fix #4 Added setting similar to DELTAFETCH_RESET

Expected usage: in settings.py: CRAWL_ONCE_RESET = True or in terminal: scrapy crawl spider_name -a crawl_once_reset=True

If True, SqliteDict.clear() is called on the db

SteveSmirnoff avatar Mar 17 '21 09:03 SteveSmirnoff