spidermon

spidermon copied to clipboard

`jsonschema` latest version removed `jsonschema.compat` module. [According to its author]([https://github.com/Julian/jsonschema/issues/843#issuecomment-931247200), this module was intended to be private and not used by external users. We are using this module in some...

rennerocha

feature: New built-in action to create Freshdesk tickets

4

At the moment built-in actions focus on supporting different alert systems. It would be nice to support ticketing systems by default, as automatically reporting issues based on Spidermon alerts is...

curita

At the moment built-in actions focus on supporting different alert systems. It would be nice to support ticketing systems by default, as automatically reporting issues based on Spidermon alerts is...

curita

feature: Fallback for actions

5

This was an idea proposed by Chandral from Zyte to address Sentry downtimes, as important Spidermon alerts might get lost while this happens. Multiple alert actions can be configured in...

curita

Add `JobsComparisonMonitor`

2

closes #301 It adds the `JobComparisonMonitor`, for checking for drops in scraped item count compared to previous jobs, when running jobs in [Scrapy Cloud](https://www.zyte.com/scrapy-cloud). - allow filtering by jobs states...

tcurvelo

Added SMTP email support

8

Adding the support for SMTP email support

shafiq-muhammad

Adding extra arguments for Slack Message like reply to thread & markup

1

Fixes https://github.com/scrapinghub/spidermon/issues/293 - Initial push as WIP. - I have some more queries regarding this.

muneer22

At the moment the Python 3.10 docs build throws an error in `master`. **Logs:** ``` Warning, treated as an error: /home/runner/work/spidermon/spidermon/docs/source/actions/email-action.rst:67:broken link: https://docs.scrapy.org/en/latest/topics/settings.html#std:setting-AWS_ACCESS_KEY_ID (Anchor 'std:setting-AWS_ACCESS_KEY_ID' not found) ERROR: InvocationError for...

curita

Allow pass extra optional arguments to Slack API

3

When sending a [Slack message](https://github.com/scrapinghub/spidermon/blob/master/spidermon/contrib/actions/slack/__init__.py#L111) we don't have an easy way to provide extra arguments to [postMessage](https://api.slack.com/methods/chat.postMessage) method (`mrkdwn` or `thread_ts` for example). It would be good to be able...

rennerocha

I've seen some code in projects, with a pipeline like this: ```py # The pipeline needed to make Spidermon and attr items work nicely. class ItemToDictTransformPipeline: def process_item(self, item, spider):...

kmike