paimon

paimon copied to clipboard

[FLINK-31224] add metrics for flink table store

1

zhangjun0x01

- We have done some tests. Parquet is 30% faster. - After [FLINK-30565](https://issues.apache.org/jira/browse/FLINK-30565), Parquet can support complex types and file systems such as OSS and s3 (decoupled from hadoop filesystem)....

SteNicholas

[FLINK-26465] Optimize SortMergeReader: use loser tree to reduce comparisons

1

[FLINK-26465] Optimize SortMergeReader: use loser tree to reduce comparisons

GOODBOY008

Introduce_clone_Action_and_Procedure_0418

1

### Purpose Linked issue: [open [Feature] Introduce clone Action and Procedure](https://github.com/apache/paimon/issues/3229) ### Tests ### API and Format ### Documentation

wwj6591812

[Feature] Support Flink read / write data branch

6

### Purpose Linked issue: close (https://github.com/apache/incubator-paimon/issues/2861) When writing and reading branch data for Flink, it was found that if the "TableCommitImpl newcommit (String commitUser, String branchName)" interface is added like...

sunxiaojian

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation In stream mode, the unaware bucket mode will use the `FIFOSplitAssigner`, So we...

Aitozi

### Purpose Linked issue: close #xxx Filter out invalid splits to improve flink database compaction efficiency (1) Referring to the pickFullComparison method of CompactStrategy, filter out whether dataFiles is empty...

zhourui999

### Purpose This PR adds a `numWriters` metrics to monitor the number of active writers in each parallelism. This metric can help us determine if the memory shortage is caused...

tsreaper

[Bug] After the flink job written to Paimon modifies `sink.parallelism`, the job will not be able to recover from the checkpoint

3

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version master ### Compute Engine flink ### Minimal reproduce step 1. First set...

huyuanfeng2018

[core] support decouple the delta files lifecycle

2

### Purpose This PR is meant to support decouple the delta files lifecycle #2899 The basic idea behind this is that: - Add fileSource in `DatafileMeta` to indicate whether this...

Aitozi