scrapeops-scrapy-sdk
scrapeops-scrapy-sdk copied to clipboard
ScrapeOps
Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the box.
ERROR: Cannot install -r requirements.txt (line 30), -r requirements.txt (line 32), urllib3=2.1 and ](https://github.com/psf/requests/issues/6432#issue-1685467871) > **But currently requests 2.29.0 has a range bound on it: =1.21.1 for urllib3.** same issue...
```python Traceback (most recent call last): File \"/usr/local/lib/python3.11/site-packages/scrapeops_scrapy/core/error_logger.py\", line 141, in emit dateTime = record.asctime ^^^^^^^^^^^^^^ AttributeError: 'LogRecord' object has no attribute 'asctime' ```
Hi! We're using https://github.com/scrapedia/scrapy-cookies for cookies persistence. They add multiple [default settings](https://github.com/scrapedia/scrapy-cookies/blob/master/scrapy_cookies/settings/default_settings.py), but there is one that prevents `scrapeops-scrapy-sdk` from sending `setup` request `COOKIES_MONGO_MONGOCLIENT_DOCUMENT_CLASS = dict` I have no idea...
When it is written in the settings `BASE_DIR = Path(__file__).resolve().parent.parent` the extension does not send statistics to the API. Even if it is written in another module and then imported...
