paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Feature] Support to read the append queue table in order in batch mode

Open Aitozi opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Motivation

Currently, in batch mode, we do not respect the order of the append queue table. I believe that maintaining the order can be beneficial in certain situations. For instance, if the order is not preserved, each time we batch read from a queue table and write into a first_row table, the results will vary. Therefore, I suggest adding a mode that allows batch reading to also preserve the order within buckets.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

  • [X] I'm willing to submit a PR!

Aitozi avatar Sep 09 '24 11:09 Aitozi