amoro

amoro copied to clipboard

[AMORO-2391] For Mixed-Hive tables, default refresh time for Hive partitions should be configured

2

## Why are the changes needed? Close #2391 ## Brief change log -Set the default value of REFRESH_HIVE_INTERVAL to half an hour ## How was this patch tested? - [...

shendanfengg

[AMORO-1619] 0.4.x support copy large files when executing full optimizing of Unkeyed Mixed Hive Table

3

## Why are the changes needed? Close #1619 . ## Brief change log - optimizers support copy files to new hive locations if all files in this task are large...

wangtaohz

[Bug]: Unpartitioned tables in Mixed-Hive format generate a lot of .keep files

1

### What happened?    As shown in the figure in the Mixed-Hive Format for unpartitioned tables each commit will generate an empty file /.keep, which will lead to...

shendanfengg

[Improvement]: Improve unit test cases for Amoro project

1

### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Unit testing is an important...

zhoujinsong

### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Unit testing is an important...

lklhdu

### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/amoro/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? A version conflict of Guava...

hameizi

### What happened? Dead lock found in AMS  ### Affects Versions master ### What engines are you seeing the problem on? _No response_ ### How to reproduce _No response_...

baiyangtx

### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/amoro/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? create catalog arctic with (...

YesOrNo828

### Description The expiring processes(including snapshot expiration, orphan file cleaning, and data file expiration, etc) on tables, should be executed in the Optimizer instead of in the AMS. ### Use...

zhoujinsong

### What happened? Currently, we create `TableOptimizingProcess` after the planner is ready:  When optimizing tasks are not committed, the snapshot with which it planned should not be expired: ...

HuangFru