amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Feature]: Report Amoro expiration events

Open xxubai opened this issue 1 year ago • 0 comments

Description

Amoro automatically maintains metadata files for datalakes. Each maintenance action, such as expiring snapshots, removing orphan files, etc., can be considered as an expiration event. Amoro provides an event listener mechanism to monitor these events. Users can also customize listeners to handle these events, such as triggering downstream jobs.

Use case/motivation

monitor expiration events and trigger downstream jobs

Describe the solution

https://docs.google.com/document/d/1ILvOqZvB6uQ3Z0BgRI3qMHGc8te6d0x_k2hME0IllZE/edit?usp=sharing

Subtasks

No response

Related issues

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

xxubai avatar Feb 05 '24 09:02 xxubai