paimon
paimon copied to clipboard
apache
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.8-SNAPSHOT ### Compute Engine JavaAPI ### Minimal reproduce step Nothing to do...
### Purpose Linked issue: close #xxx ### Tests ### API and Format ### Documentation
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.7.0 ### Compute Engine Flink 1.17.2 ### Minimal reproduce step Not sure....
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation Currently, the aggregation merge engine only produce `INSERT` row. However, if all the...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Currently, partial update in paimon only supports mor and generates a completed changelog...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation Motivation is to make paimon readable by databricks sql endpoints ### Solution After...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation for now it's not allowed to delete records in a partial-update table. even...
### Purpose This PR is intended to support a mechanism for marking a partition as finished and subsequently pulling up offline scheduling jobs. Unlike Flink's Filesystem (which came from my...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation flink cdc ColumnPosition support: BEFORE、AFTER、FIRST、LAST https://github.com/apache/flink-cdc/blob/fa6e7ea51258dcd90f06036196618224156df367/flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/AddColumnEvent.java#L53 ### Solution _No response_ ### Anything else?...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Unified options like bloom filter for reader and writer in different file format...