paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[help] Using Java-API to implement incremental reading between Snapshots

Open LWWD opened this issue 9 months ago • 0 comments

Search before asking

  • [x] I searched in the issues and found nothing similar.

Motivation

I want to implement incremental data reading of snapshots using the Java-API. I wrote a little bit myself, but I have a few questions to answer.

  1. Can I only read the deltaManifest file of a snapshot of type APPEND?
  2. If not, how should I handle a large amount of old data (INSERT) in a COMPACT type?
  3. If possible, I would like to learn how Flink implements it(incremental-between), but I can't find any relevant documentation.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

  • [ ] I'm willing to submit a PR!

LWWD avatar Mar 25 '25 09:03 LWWD