amoro
amoro copied to clipboard
Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/amoro/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? ### How should we improve?...
### Description The state of the manifest files can affect the query performance of the data lake tables. Amoro should support rewriting manifest files automatically for tables to ensure query...
## Why are the changes needed? Close #2365. ## Brief change log - Add 'PLANNING' status in `OptimizingProcess.Status' and set it as default. - Generic the `TableOptimizingProcess` when the table...
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/amoro/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Currently, each search for a...
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Before version 1.3.x of Iceberg,...
### What happened? 2023-12-13 01:54:44,591 ERROR [async-orphan-files-cleaning-executor-4] [com.netease.arctic.server.table.executor.OrphanFilesCleaningExecutor] [] - ice-01.ods_bps.ods_ebeb(tableId=677) failed to clean orphan file java.lang.NullPointerException: null at com.netease.arctic.server.optimizing.maintainer.IcebergTableMaintainer.cleanOrphanFiles(IcebergTableMaintainer.java:140) ~[amoro-ams-server-0.7.0-SNAPSHOT.jar:?] at com.netease.arctic.server.table.executor.OrphanFilesCleaningExecutor.execute(OrphanFilesCleaningExecutor.java:61) ~[amoro-ams-server-0.7.0-SNAPSHOT.jar:?] at com.netease.arctic.server.table.executor.BaseTableExecutor.executeTask(BaseTableExecutor.java:74) ~[amoro-ams-server-0.7.0-SNAPSHOT.jar:?] at com.netease.arctic.server.table.executor.BaseTableExecutor.lambda$scheduleIfNecessary$4(BaseTableExecutor.java:83) ~[amoro-ams-server-0.7.0-SNAPSHOT.jar:?]...
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Add guava check to checkstyle...
## Why are the changes needed? Close #2273. ## Brief change log - Remove in-memory Content file cache for mixed-format Table Maintainer. - Refactor logic of fetch all manifest file...
### Description Just like the `Optimizing` tab, we should add an `Expiratiing` tab in the table detail page to display all historical and ongoing expiration operations on the table, including...
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/amoro/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved?   Current Base table...