paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Set the following parameters when creating a table: tag.creation-period'='daily', 'tag.creation-delay' =' 0 m',...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Currently, Paimon metadata does not store the absolute paths of files but uses...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.8 ### Compute Engine spark3.4 ### Minimal reproduce step i want to...
Purpose Linked issue: https://github.com/apache/paimon/issues/5092 Tests n/a API and Format n/a Documentation n/a
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation The tables with pk are ingested into paimon with batch processing tasks initialy,...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 9d2a4605dffc39ddb0e5d0b8733c02bf9ea42c68 ### Compute Engine flink 1.17 ### Minimal reproduce step 1.Establish a...
### Purpose Linked issue: close #5084 Fix the JDBC connection expiration used by the lock, which causes data loss when committing the snapshot. ### Tests JdbcClientPoolTest is used to test...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version paimon-flink-1.20-1.0.1.jar paimon-s3-1.0.1.jar paimon-flink-action-1.0.1.jar ### Compute Engine flink-1.20.0 ### Minimal reproduce step Use...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation I face some issue when loading a big database from mysql to paimon...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 1.0.0 ### Compute Engine spark3.3 ### Minimal reproduce step execute desc tableName...