paimon

paimon copied to clipboard

[Feature] Improve the tryCommitOnce behavior in FileStoreCommitImpl

2

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation When using dedicated compactions in production, we've found the write only job and...

xiangyuf

### Purpose Follow up https://github.com/apache/paimon/pull/3832 had support NumericPrimitive to Timestamp casting，this pr support Timestamp to NumericPrimitive casting. Linked issue: close #xxx ### Tests CastExecutorTest##testTimestampToNumeric ### API and Format ### Documentation

xuzifu666

[common] [flink] Add support for complex types in kafka debezium avro cdc action.

1

### Purpose @zhuangchong has a an outstanding PR that allows support for debezium avro format in cdc action. That PR: #3323 The above patch allows consuming data from avro data...

umeshdangat

[spark] Support auto disable bucketed scan

1

### Purpose This pr adds a new rule `DisableUnnecessaryPaimonBucketedScan` to support auto disable bucketed scan if the bucket scan is not actually effective i.e., there is no shuffle exchange been...

ulysses-you

[Security] Bump aircompressor and commons-compress to fix cve problems

1

```bash ┌────────────────────────────────────────────────────┬────────────────┬──────────┬────────┬───────────────────┬───────────────┬─────────────────────────────────────────────────────────────┐ │ Library │ Vulnerability │ Severity │ Status │ Installed Version │ Fixed Version │ Title │ ├────────────────────────────────────────────────────┼────────────────┼──────────┼────────┼───────────────────┼───────────────┼─────────────────────────────────────────────────────────────┤ │ io.airlift:aircompressor (paimon-bundle-0.8.2.jar) │ CVE-2024-36114 │ HIGH │ fixed │...

Smith-Cruise

[core] support check partition expire when batch mode or bounded stream

1

In my company, some paimon user have reported the following issue : Everyday the batch jobs have a running time lower than config partition.expiration-check-interval, so many partitions that should have...

wwj6591812

[Bug] [core] The java api calls Tableimp.write to write data and throws exception

2

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.9-SNAPSHOT ### Compute Engine JAVA API ### Minimal reproduce step all 4...

hawk9821

### Purpose to support the compaction on append table with Deletion Vector. Linked issue: close #xxx ### Tests ### API and Format ### Documentation

YannByron

[core] Support commit isolation level

2

### Purpose For the file system catalog, there are many situations where we need to support stricter commit policies.This is especially true for third-party databases that use paimon as their...

BsoBird

[core]IcebergConversions addType for Timestamp and Time

11

### Purpose Linked issue: close #3788 IcebergConversions addType for Timestamp and Time ### Tests IcebergDataTypeCompatibilityTest ### API and Format ### Documentation

dbac