paimon
paimon copied to clipboard
apache
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation HiveCatalog supports client pool. ### Solution _No response_ ### Anything else? _No response_...
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation subtask of #2824 ### Solution _No response_ ### Anything else? _No response_ ###...
### Purpose Add MergeBranchProcedure to support branch merge Linked issue: https://cwiki.apache.org/confluence/display/PAIMON/PIP-9%3A+Support+Branch support merge branch ### API and Format ### Documentation
### Purpose Linked issue: close #2969 If the execution time of a batch job is short, and it's less than the interval for partition expiration checks, the partition expiration operations...
### Purpose Linked issue: close #2967 Sort compact only supports write-only mode, during which expiration operations are not performed. When users write data in write-only mode and use sort compact...
1. fix alter hive Table StorageDescriptor location is empty issue; 2. Add a switch for statistics on file information under Hive Metastore table location, skip HMS FileSystem scan. ### Purpose...
### Purpose Linked issue: open #2708 Add a Chinese version for the documentation, while new Chinese files (stored in `docs/content.zh`) are still the same in English (stored in `docs/content`), needing...
### Purpose Delete one partition in flink will not produce changelog. But anyway, it should. The pr has done two things: 1、Before delete push down, check the row count, if...
### Purpose Add a parameter to limit the number of partitions for user queries to avoid full table scan when the table is too large refer to hive `hive.metastore.limit.partition.request` https://cwiki.apache.org/confluence/display/hive/configuration+properties#ConfigurationProperties-hive.metastore.limit.partition.request...
### Purpose Linked issue: close #2495 ### Tests ### API and Format ### Documentation
