paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Support Spark4.0 (preview1) ### Solution _No response_ ### Anything else? _No response_ ###...
### Purpose Linked issue: close #3868 [flink] refactor the code of the lookup and support computing the changelog generated by compact during read time. This is used when changelog producer...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version since 0.8.0 ### Compute Engine any ### Minimal reproduce step `deletionVectorsRanges` is...
### Purpose Linked issue: close #4139 Add benchmark for reader and writer with bloom filter in sort file store ### Tests no ### API and Format no ### Documentation no
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation I activated the privilege system. In our business scenario, I want to collect...
### Purpose Linked issue: close #xxx The topic variable should be assigned from kafka `ConsumerRecord` in debezium avro deserialization. ### Tests ### API and Format ### Documentation
### Purpose `created_from_snapshot` should be the origin of the tag,not the earliest snapshot of the branch. Linked issue: close #xxx ### Tests ### API and Format ### Documentation
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version master ### Compute Engine flink ### Minimal reproduce step #### First case...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version master ### Compute Engine flink ### Minimal reproduce step 1. Create a...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Currently, in batch mode, we do not respect the order of the append...