paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Feature] Support copy-on-write for partial update merge function

Open FangYongs opened this issue 1 year ago • 1 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Motivation

Currently, partial update in paimon only supports mor and generates a completed changelog during full compaction. We hope that partial update will support the cow mode to directly generate complete data of columns during writing, so that downstream jobs can read the complete updated results immediately

Solution

no

Anything else?

no

Are you willing to submit a PR?

  • [ ] I'm willing to submit a PR!

FangYongs avatar May 07 '24 08:05 FangYongs

Try changelog-producer = lookup?

JingsongLi avatar May 11 '24 03:05 JingsongLi