web-scraping-parallel-processing

web-scraping-parallel-processing copied to clipboard

Bumps [requests](https://github.com/psf/requests) from 2.24.0 to 2.31.0. Release notes Sourced from requests's releases. v2.31.0 2.31.0 (2023-05-22) Security Versions of Requests between v2.3.0 and v2.30.0 are vulnerable to potential forwarding of Proxy-Authorization...

dependabot[bot]

Hi Caleb Was wondering if you tried using this for many thousands of websites. I adapted what you wrote, but the geckodrvier and marionette processes just keep increasing in memory...

dejmail