paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.7.0-incubating ### Compute Engine Flink 1.18.0 ### Minimal reproduce step we have...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.8 ### Compute Engine Flink ### Minimal reproduce step ## Analyze source...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation paimon flink connector is not support unaligned checkpoint now. ### Solution _No response_...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation In #3731 we've introduced `IcebergCommitCallback` to create Iceberg metadata after commit. We convert...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version paimon-flink-1.18-0.9-20240610.002222-13 paimon-flink-action-0.9-20240610.002222-13 ### Compute Engine flink1.18 ### Minimal reproduce step In the...
### Purpose Linked issue: close #xxx ### Tests ### API and Format ### Documentation
### Purpose Linked issue: close #3803 ### Tests ### API and Format ### Documentation
### Purpose In issue#3757, Paimon has Support using table branches with $branch_ and support different schemas for different branches. Therefore, this PR complete the branch function and test it for...
### Purpose This PR makes FlinkCatalogFactory pluggable. ### Tests Unit tests are added in CompactionITCase to cover the introduced code. ### API and Format This change does not affect format,...
### Purpose This PR introduces RecordAttributesProcessor for write operators, providing the ability to handle record attributes during constructing sink operators. ### Tests WriteOperatorTest.testProcessRecordAttributes is introduced to verify the correctness of...