spidermon
spidermon copied to clipboard
Scrapy Extension for monitoring spiders execution.
Added following monitors to test requests success rate - ZyteAPIErrorRatioMonitor - SPMErrorRatioMonitor
This pull request restores the **_convert_item_to_dict** functionality in the ItemValidationPipeline, which was available in previous versions but removed in the current release. For users who extended the ItemValidationPipeline with the...
The SPIDERMON_MONITOR_SKIPPING_RULES setting is currently only used within SpiderCloseMonitorSuite, limiting its functionality to suites that extend from it: https://github.com/scrapinghub/spidermon/blob/d7d553a69453a1b94dac85596cb663dea9093696/spidermon/contrib/scrapy/monitors/suites.py#L61 This limitation is not mentioned in the documentation. It would be...
When performing a division operation, the result is returned in scientific notation, even though it could be represented in standard decimal format for better readability. For example, the result of...
Running `twine check` has proven useful in the past so we add it to all projects when we can remember it, please do that here too (and run it manually...