paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation Whole database compression combined mode does not support append unware bucket table。 ...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation @yuzelin 由于我们采用整库同步,单个 topic 里存在多个表,CDC采集侧也不受我们控制,受限于整体的数据量大,其中仅有极少数CDC的update数据有before前项。 我们惊奇发现 [Apache Paimon changelog producer](https://paimon.apache.org/docs/master/primary-key-table/changelog-producer/),因此想要同步至 Paimon ODS 中采用 lookup...
### Purpose related https://github.com/apache/paimon/issues/2670 ### Tests ### API and Format ### Documentation
related #2670 ### Purpose Linked issue: close #xxx ### Tests AppendOnlyMultiTableCompactionWorkerOperatorTest.java for test AppendOnlyMultiTableCompactionWorkerOperator ### API and Format ### Documentation
### Purpose Linked issue: (https://github.com/apache/incubator-paimon/issues/2113) ### Tests ### API and Format ### Documentation
### Purpose Linked issue: close https://github.com/apache/incubator-paimon/issues/2884 ### Tests ### API and Format ### Documentation
### Purpose 1.Support creating empty branches and rewriting data from scratch 2.Support creating branches directly from snapshots instead of tags Linked issue: https://github.com/apache/incubator-paimon/issues/2847 ### Tests ### API and Format ###...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation Now we have seen significant improvements in query performance through index creation. However,...
### Purpose Linked issue: close (https://github.com/apache/paimon/issues/3032)
### Purpose Subtask of https://github.com/apache/incubator-paimon/issues/1795 ### Tests FileStoreTableTestBase ### API and Format ### Documentation