scrapyscript
scrapyscript copied to clipboard
jschnurr
Run a Scrapy spider programmatically from a script or a Celery task - no project required.
Bumps [certifi](https://github.com/certifi/python-certifi) from 2021.10.8 to 2022.12.7. Commits 9e9e840 2022.12.07 b81bdb2 2022.09.24 939a28f 2022.09.14 aca828a 2022.06.15.2 de0eae1 Only use importlib.resources's new files() / Traversable API on Python ≥3.11 ... b8eb5e9 2022.06.15.1...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [scrapy](https://github.com/scrapy/scrapy) from 2.5.1 to 2.7.1. Release notes Sourced from scrapy's releases. 2.7.1 Relaxed the restriction introduced in 2.6.2 so that the Proxy-Authentication header can again be set explicitly in...
Bumps [twisted](https://github.com/twisted/twisted) from 21.7.0 to 22.10.0. Release notes Sourced from twisted's releases. Twisted 22.10.0 (2022-10-30) This release contains a security fix for CVE-2022-39348. This is a low-severity security bug. Twisted...
Bumps [lxml](https://github.com/lxml/lxml) from 4.6.4 to 4.9.1. Changelog Sourced from lxml's changelog. 4.9.1 (2022-07-01) Bugs fixed A crash was resolved when using iterwalk() (or canonicalize()) after parsing certain incorrect input. Note...
Bumps [poetry](https://github.com/python-poetry/poetry) from 1.0.10 to 1.1.9. Release notes Sourced from poetry's releases. 1.1.9 Fixed Fixed a security issue where file hashes were not checked prior to installation. (#4420, #4444, python-poetry/poetry-core#193)...
Bumps [celery](https://github.com/celery/celery) from 5.2.1 to 5.2.2. Release notes Sourced from celery's releases. 5.2.2 Release date: 2021-12-26 16:30 P.M UTC+2:00 Release by: Omer Katz Various documentation fixes. Fix CVE-2021-23727 (Stored Command...
Hey all, this is exactly what I was looking for, but running into a few problems trying to test it out on Windows. Using the following I get the error...
Hi, I am trying to use a CrawlSpider with Celery. The settings for the CrawlSpider are stored in the database. But what i try i can not get the settings...
Scrapy will by default attach a new root logger to a CrawlerProcess. There is a controllable boolean present in scrapy these days to configure this, so I've created a passthrough...
