amoro
amoro copied to clipboard
[Feature]: Report Amoro expiration events
Description
Amoro automatically maintains metadata files for datalakes. Each maintenance action, such as expiring snapshots, removing orphan files, etc., can be considered as an expiration event. Amoro provides an event listener mechanism to monitor these events. Users can also customize listeners to handle these events, such as triggering downstream jobs.
Use case/motivation
monitor expiration events and trigger downstream jobs
Describe the solution
https://docs.google.com/document/d/1ILvOqZvB6uQ3Z0BgRI3qMHGc8te6d0x_k2hME0IllZE/edit?usp=sharing
Subtasks
No response
Related issues
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct