paimon
paimon copied to clipboard
apache
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Purpose add test case for two sessions with cache for rest commitTable ### Tests PaimonSparkTwoSessionCacheTest ### API and Format ### Documentation
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation In dynamic bucket mode, when buckets fill up and the system runs out...
### Purpose Linked issue: close #xxx ### Tests ### API and Format ### Documentation
### Purpose see: https://cwiki.apache.org/confluence/display/PAIMON/PIP-37%3A+Introduce+Chain+Table ## 1. Overview Chain Table is a new feature in Paimon designed to solve the problem of periodically storing full data in data warehouses. It optimizes...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Chain table is a new table type designed for data warehouse where full...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 1.0.1 ### Compute Engine Flink 1.18.1 ### Minimal reproduce step #### 1....
### Purpose Disable v2 write in v1 append location unit tests The operation ```batch.write.format("paimon").mode("append").save(location)``` throws an exception when v2 write is enabled. Therefore, it is necessary to explicitly disable v2...
### Purpose Fixes job failures when Kafka CDC ingestion encounters corrupt or unparsable records. Instead of crashing the job, users can now configure the parser to skip invalid records with...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Add util class to help build Flink CDC Source/Sink for Paimon. ### Solution...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation The chain table's partition expire strategy should be adjusted to the chain semantic...
