paimon
paimon copied to clipboard
apache
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
… ### Purpose When the cdc source modifies field comments, all field comments in the existing paimon table will be set to empty. Steps: Version 0.7, flink1.17, mysqlcdc2paimon whole database...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation # Motivation Currently, the changelog's lifecycle is binding with the snapshot, when snapshot...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Support feature in #3119 . ### Solution _No response_ ### Anything else? _No...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Currently, Paimon has automatic clearing mechanisms for tags created by TagAutoCreation, but not...
…eader.enabled ### Purpose CDC supports configuring parameter scan.incremental.close-idle-reader.enabled Linked issue: close #xxx ### Tests ### API and Format ### Documentation
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation We have a flink task，only one commit user ,and set 'changelog-producer' = 'lookup',...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Sync mysql data to paimon. If the detele operation fails to delete data...
### Purpose Linked issue: close #2198 and #2200 ### Tests Added source table lineage in test FlinkLineageITCase#testDataLineage ### API and Format ### Documentation
### Purpose Linked issue: close #1401 Implement Purge table for SparkCatalog ### Tests ### API and Format ### Documentation
Refact the compaction of combine mode for supporting compacting unaware bucket table ### Purpose Linked issue: close #2670 ### Tests [CompactDatabaseActionITCase.java](https://github.com/apache/incubator-paimon/pull/2858/files#diff-9eae358dbfd2474f886992026b8840e7a0d2438bef74eae239fa98974462287c) for IT case in stream and batch mode CompactionTaskSerializerTest.java...
