data.gov icon indicating copy to clipboard operation
data.gov copied to clipboard

Harvester Email

Open jbrown-xentity opened this issue 1 year ago • 2 comments

User Story

In order to notify data providers of harvest job completion and/or errors, data.gov data providers want an email sent out on harvest job completion.

Acceptance Criteria

[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]

  • [ ] GIVEN the email is extractable from the CKAN organization
    WHEN a harvest job occurs for a given harvest source
    THEN an email is sent with a summary to the emails specified above
    AND there is some way to digest the problems (whether in the email, or through a link)

Background

Popped into my brain from this comment, what do we do with errors. This is what we do.

Security Considerations (required)

No security considerations. Some data providers may balk at their harvests being publicly available

Sketch

No idea at this point. Need to investigate airflow options and best practices, possibly utilizing the SES cloud.gov service (to keep email from point consistent). If there are no out of the box items, change this to a spike/discovery ticket on how to approach this problem.

jbrown-xentity avatar Jan 05 '24 22:01 jbrown-xentity