amoro

amoro copied to clipboard

[Feature]: New Map for Streaming-Inline-Upsert reader

1

### Description In Streaming-Inline-Upsert design the change data need index into map, so the map must support spill data to disk to avoid oom. In this pr, the map first...

shidayang

[Feature]: Support insert part of columns of mixed-format table with flink in streaming mode

3

### Description Support insert part of columns of arctic table with flink in streaming mode ### Use case/motivation Arctic only support insert all table columns with flink in streaming mode...

zhoujinsong

[Feature]: Adapt AMS for Streaming-Inline-Upsert

1

### Description 1. mysql add column to identity table type 2. one table need multi change. need multi change location ### Use case/motivation _No response_ ### Describe the solution _No...

shidayang

[Feature]: Reconstruct metastore for Streaming-Inline-Upsert

1

### Description 1. Table dir construct need reconstruct 2. Add a new table type contain multi change table 3. flink can see sub table of Inline-Upsert table ### Are you...

shidayang

[Feature]: Reconstruct optimize for Streaming-Inline-Upsert

1

### Description _No response_ ### Use case/motivation _No response_ ### Describe the solution _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [...

shidayang

[Feature]: Adapt streaming writer for Streaming-Inline-Upsert

1

### Description 1. Deleting data need to write delete file 2. Upsert data only need to write insert file ### Are you willing to submit a PR? - [ ]...

shidayang

[Feature]: New plan for Streaming-Inline-Upsert

1

### Description 1. Need remove predicate pushdown in plan. 2. Need share all change files in every task. 3. Task can get schema for every change file ### Are you...

shidayang

### What happened? When running a dimensional join on an Arctic table with partitions as a dimensional table, select Arctic table fields will encounter ClassCastException. ### Affects Versions master/0.3.1 ###...

lklhdu

[Feature]: Adapt trino for Streaming-Inline-Upsert

1

### Description _No response_ ### Use case/motivation _No response_ ### Describe the solution _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [...

shidayang

[Feature]: Adapt flink for Streaming-Inline-Upsert

1

### Description _No response_ ### Use case/motivation _No response_ ### Describe the solution _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [...

shidayang