paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 1.2.0 ### Compute Engine Spark ### Minimal reproduce step `SparkCatalog::initialize` accepts a...
### Purpose This adds to https://github.com/apache/paimon/pull/4318 by allowing Paimon millisecond type to be converted to the canonical microseconds in Iceberg. We ingest data from Kafka and other sources into Paimon...
### Purpose Linked issue: close https://github.com/apache/paimon/issues/6357 ### Tests ### API and Format ### Documentation
### Purpose User may be confused, when perform `alter table add partition` without any exceptions, but run `show partitions` return nothing ### Tests ### API and Format ### Documentation
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation In the process of integrating services like the Amoro Lakehouse management system with...
### Purpose Linked issue: close #6221 read-optimized via hints ### Tests ### API and Format ### Documentation
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation In Paimon, when dropping table, the data is directly removed. We can implement...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version master branch `d0b66f272ca5cdfb4f8f588b37b2461f1c34e06c` ### Compute Engine Flink ### Minimal reproduce step When...
### Purpose Data evolution table total records in snapshot should be more accurate ### Tests ### API and Format ### Documentation
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 1.2.0 ### Compute Engine No ### Minimal reproduce step 1. Click on...