paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Purpose Linked issue: https://github.com/apache/incubator-paimon/issues/2475 ### Tests unit test is paas integration testing: #### flink test  #### hive test 
### Purpose Linked issue: close #1811 Introduce pub/sub messaging model ### Tests org.apache.paimon.event.TestListeners
### Purpose Linked issue: close #2270 ### Tests ### API and Format ### Documentation
### Purpose Linked issue: close #1480 This PR aims to introduce jdbc lineage meta with following capabilities: 1. Configure jdbc relevant options such as url, user and password 2. Create...
### Purpose spark support `Cross Partitions Upsert Dynamic Bucket Mode` ### Tests ### API and Format ### Documentation
### Purpose Linked issue: close #2185 ### Tests DataTableSourceTest#testCheckAllValuePredication FileStoreTableStatisticsTestBase#testTableFilterValueDisableStatistics Below is the tpch test result: Env: JM 64 core; TM 16 core,8 slot per tm; Paimon 0.5 x Flink...
### Purpose Linked issue: close #2141 Manage flink version ### Tests This feature is covered by existing tests ### API and Format no ### Documentation no
support query multiple tables using tag ### Tests PaimonStorageHandlerITCase ### API and Format no ### Documentation no
### Purpose in flink sync action , sync the table comment when create new table. ### Tests ### API and Format ### Documentation
### Purpose add table type to avoid sync `VIEW`,`SYSTEM DATABASE` like `mysql` ### Tests ### API and Format ### Documentation