paimon

paimon copied to clipboard

[WIP][core] cut StoreSinkWriteState when write unaware bucket table

2

### Purpose Now, when Flink bounded stream write to Paimon table. If the following conditions are met, checkpoint fail will occur, because paimon writer use flink UnionlistState. 1、If Source Operator...

wwj6591812

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Subtask of #3827 , add block cache for sorted file store ### Solution...

FangYongs

[Feature] Snapshot supports the function of recording additional information of users

2

### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation ### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found...

MonsterChenzhuo

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation In our company,user want produce daily tag base on the generation time of...

herefree

[Feature] Support lance file format

1

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Lance format provides better support for machine learning. It can better support point...

coolderli

[Feature] Introduce New Metrics for Compaction

2

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation During recent usage, we have observed that DelVector's operations are dependent on compaction,...

MonsterChenzhuo

### Purpose Linked issue: close #4030 ### Tests ### API and Format ### Documentation

rfyu

[Feature] Support Flink Materialized Table

1

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation Flink has introduced [Materialized Table](https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/dev/table/materialized-table/overview/) in 1.20 release, we can support it in...

reswqa

### Search before asking - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.8 ### Compute Engine flink ### Minimal reproduce step 1. Create a...

rfyu

[hotfix] Remove useless #withPartitionKeys call

2

### Purpose The deleted code has no effect. ### Tests ### API and Format ### Documentation

yuzelin