amoro
amoro copied to clipboard
Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
Describtion: Developer will find a error "Cannot find project Scala library 2.12.15 for module arctic-spark_3.1" when they try to reload maven project in IDE (e.g. IDEA). More precisely,this issue appear...
according to the iceberg release note, spark3.3 was supported in version 0.14+, now the default iceberg version is 0.12.
1. iceberg#OverwriteFiles implement UnkeyedHiveTable.OverwriteFiles , alter hive partition location when commit 2. iceberg#OverwriteFiles determine location of hive partition by addDataFile 3. use UnkeyedHiveTable as base store of KeyedHiveTable
This is a sub-issue, parent task is [#173 ](https://github.com/NetEase/arctic/issues/173) some questions should be clear at design docs. i. pos-delete or eq-delete for unkeyed table? ii. should batch update write log...
Support Insert/Delete/Update/MergeInto SQL in Spark TaskList (link each sub-issue at each subtask): * Design Docs #174 some questions should be clear at design docs. i. pos-delete or eq-delete for unkeyed...