paimon
paimon copied to clipboard
apache
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Purpose Linked issue: close #xxx ### Tests ### API and Format ### Documentation
### Purpose Linked issue: close #xxx ### Tests ### API and Format ### Documentation
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation The defining function includes the parameter, output, and function body. The output result...
### Purpose Optimize partition statistical row count ，avoid duplicate calculations ### Tests PartitionStatisticsReporterTest
### Purpose style: change dataFiles method to dataFileMetas 。 DataFiles makes it easy for us to confuse data files with metadata files。method and field DataFiles not a good name ###...
### Purpose Linked issue: part of https://github.com/apache/paimon/issues/4816 Support spark datasource v2 write path, reduce write serialization overhead and accelerate the process of writing to primary key tables in Spark. Currently...
### Purpose support query options in listTables/listViews ### Tests RESTCatalogTest ### API and Format rest-catalog-open-api.yaml ### Documentation
### Purpose Linked issue: https://github.com/apache/paimon/issues/5511. The result of compact procedure is true or false in default. For one compact job call, we want to know the detailed results, for example,...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Enhance return result for procedure. - [x] compact - [x] rollback/rollback_timestamp/rollback_watermark - [...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version The latest code in master branch on Apr 22, commit id =...
