scrapy-puppeteer icon indicating copy to clipboard operation
scrapy-puppeteer copied to clipboard

Context restoring

Open MatthewZMSU opened this issue 8 months ago • 1 comments

Description

Implemented new downloader middleware for restoring contexts when they are destroyed. Added example spider. Added info about the middleware to README.

Restructured the project to have more than 1 middleware. Changed init.py in the corresponding way to provide backward compatibility.

Type of change

  • [x] New feature (non-breaking change which adds functionality)
  • [x] This change requires a documentation update

How Has This Been Tested?

I tested the middleware with several spuder on my PC.

Checklist:

  • [x] My code follows the style guidelines of this project
  • [x] I have performed a self-review of my code
  • [x] I have commented my code, particularly in hard-to-understand areas
  • [x] I have made corresponding changes to the documentation
  • [x] My changes generate no new warnings

MatthewZMSU avatar May 29 '24 15:05 MatthewZMSU