paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Paimon version d44741d6aaa43a73a20ef96979a8ded72efc2f6c ### Compute Engine Flink ### Minimal reproduce step https://github.com/apache/incubator-paimon/actions/runs/4464527298/jobs/7840743848 ### What...
Stop using old interfaces.
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation 1. 支持Datax读取 ### Solution _No response_ ### Anything else? _No response_ ### Are...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation Skip code CI tests if the PR only contains docs change to save...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Paimon version 851e8d432fb35edfc3ed6a836e5cebaa2a0c0aa3 ### Compute Engine Flink ### Minimal reproduce step Several blocking iterators...
We have already introduced `StreamTableScan`, the plan can not contain snapshot id, so empty splits can be returned. The plan can never be null.
In `lookup` and `full-compaction` changelog-producer, same record will produce -U and +U, but they are the same. We can provide a option to avoid producing changelog for the same record.
Support table statistics in table store
At present Hudi and Iceberg supports the Spark call procedure command to execute the table service action etc. Flink Table Store could also support Spark call procedure command to run...