spidermon
spidermon copied to clipboard
scrapinghub
Scrapy Extension for monitoring spiders execution.
Resolves #293
Allow usage of SPIDERMON_EMAIL_SUBJECT_TEMPLATE instead of SPIDERMON_EMAIL_SUBJECT without failing during initialization. If EMAIL_SUBJECT is configured it still has precedence.
Add a new optional setting to Amazon SES E-mail action that allows the user to specify an email address that will process any bounces that occur in the e-mails sent....
**Disclaimer:** I'm a Python beginner and have been using Scrapy for the past 5 months, so please bear with me since this is the first GitHub Issue I've ever written....
This came from a real use case: `FieldCoverageMonitor` requires that we have at least one item returned, or else it will fail. However there are situation when we allow a...
There is already an old open PR for this action: https://github.com/scrapinghub/spidermon/pull/204 Currently we only have the option to send e-mail reports using Amazon SES. If we want to use a...
This monitor is more useful when we are running the spider in [Scrapy Cloud](https://www.zyte.com/scrapy-cloud/). The objective is to compare the number of extracted items in current job with the number...
The only thing we used from this module was the `str_types` [which, for Python 3, is just `str`](https://github.com/Julian/jsonschema/blob/077feca5c176dd740b30d3f1084b6622076129e7/jsonschema/compat.py#L26). In the source it's a tuple, but I `isinstance` accepts both a...
Spidermon could have a periodic monitor that validates that the amount of items (tracked in the stat `item_scraped_count`) increases after every check. This will alert us of jobs that are...
This PR aims to fix the flaky test on **test_validators_schematics.py::test_choices** so the test could pass single run, multiple test run, and random test run. I'm doing this for a course...
Metadata
Owner
Metadata
Scrapy Extension for monitoring spiders execution.