scrapydo
scrapydo copied to clipboard
Cookies are not persisted
When using scrapydo.fetch, cookies are not persisted between calls. This happens because each call to fetch creates a crawler and an engine which instantiate all the related extensions and middlewares, once it finishes these instances are destroyed. Hence there is no information persisted between fetch calls.