paimon
paimon copied to clipboard
apache
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Purpose Linked issue: close #xxx ``` CREATE TABLE paimon.bdc_tmp.paimon_tbl ( `#log_uuid` STRING NOT NULL, `#event_name` STRING, name STRING, external_json STRING, dt STRING NOT NULL) USING paimon TBLPROPERTIES ( 'bucket'='2',...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Apache Iceberg supports AWS Glue & AWS Lake Formation to manage tables &...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation The first step to make the bucket hash function pluggable ### Solution _No...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Currently, paimon's bucket hash's hash value is based on `BinaryRow#hashcode`. It has two...
Logging Optimization add DEBUG-level log checks before logging operations; log statements use parameterized placeholder
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Two main optimizations were implemented: 1) No log level check was performed when...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version Paimon(on oss): 1.0.1 ### Compute Engine Flink: 1.20.1 ### Minimal reproduce step...
When using flink procedure, table name can not parsed correctly when use `` quote. But Spark request use `` for SYSTEM_TABLE_SPLITTER ($) . So this is incompatible with Spark. e.g...
### Motivation 2025 has arrived, and we would like to thank everyone for the contributions in the past! Here we present the 2025 Paimon Spark roadmap, and welcome to take...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation ArrowFieldWriters$ArrayWriter#doWrite  ### Solution ### **Implementation Steps** 1. **Reusable Buffer Declaration** Define a...