paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Purpose In my production environment I get compilation errors : ``` [ERROR] Failed to execute goal com.diffplug.spotless:spotless-maven-plugin:2.13.0:check (spotless-check) on project paimon-parent: Execution spotless-check of goal com.diffplug.spotless:spotless-maven-plugin:2.13.0:check failed: Unable to...
### Purpose Support lookup join update after predicate filter. ### Tests - LookupJoinITCase ### API and Format ### Documentation
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Support schema evolution about nested data type such as StructType(Spark). For example: Struct...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version paimon-flink-1.19-0.9-20240803.002144-49.jar paimon-flink-1.20-0.9-20240806.002229-1.jar ### Compute Engine java version "22.0.2" 2024-07-16 Java(TM) SE Runtime...
### Purpose Linked issue: close #3763 ### Tests ### API and Format change pom groupId com.ververica to org.apache.flink change package name com.ververica to org.apache.flink [flink-mysql-cdc 3.1.x](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.1/docs/connectors/flink-sources/mysql-cdc/#sql-client-jar) From flink cdc 3.1.x,we...
### Purpose ~~This relocates the 'path' property in the table options to 'location' for better presentation.~~ - Adapt 'path' to Spark's 'location' in table props ( the 'path' is still...
### Purpose Support renaming primary keys and bucket keys that are not partition keys. ### Tests Added schema evolution tests and Spark e2e tests ### API and Format Not affected...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Currently, two built-in compaction strategies are provided, but they are mainly set automatically...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version master ### Compute Engine Hive ### Minimal reproduce step These two tests...
### Purpose Linked issue: close https://github.com/apache/incubator-paimon/issues/2802 ### Tests ### API and Format ### Documentation