paimon
paimon copied to clipboard
[help] Using Java-API to implement incremental reading between Snapshots
Search before asking
- [x] I searched in the issues and found nothing similar.
Motivation
I want to implement incremental data reading of snapshots using the Java-API. I wrote a little bit myself, but I have a few questions to answer.
- Can I only read the deltaManifest file of a snapshot of type APPEND?
- If not, how should I handle a large amount of old data (INSERT) in a COMPACT type?
- If possible, I would like to learn how Flink implements it(incremental-between), but I can't find any relevant documentation.
Solution
No response
Anything else?
No response
Are you willing to submit a PR?
- [ ] I'm willing to submit a PR!