amoro
amoro copied to clipboard
apache
Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?page=4&q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Expose arctic benchmark code and...
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?page=4&q=is%3Aissue) and found no similar issues. ### What would you like to be improved? support apache ranger when execute...
### What happened? I used Docker to install AMS， Here is the SQL I executed in SQL Client `CREATE CATALOG arctic WITH ( 'type' = 'arctic', 'metastore.url'='thrift://127.0.0.1:1260/local_catalog' );` Create a...
### Description Unity catalog平台创建的表只支持delta，通过固定hive_catalog 接入hms，扩展Catalog，可以引入jdbc 等其他数据源，实现sql 跨源计算能力。 https://docs.databricks.com/release-notes/unity-catalog/20220825.html ### Use case/motivation _No response_ ### Describe the solution _No response_ ### Related issues _No response_ ### Are you willing to submit...
### Description 1、Now, Flink arctic sink will write records whose partition value is null to a null partition. For users, different app needs different action! some one want to send...
We have been using hudi as a data lake. Looking forward to supporting.
### Description Support for switching the default catalog。example：spark.databricks.sql.initial.catalog.name https://docs.databricks.com/data-governance/unity-catalog/hive-metastore.html ### Use case/motivation _No response_ ### Describe the solution _No response_ ### Related issues _No response_ ### Are you willing to...
### Search before asking - [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?page=4&q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Optimize plan have to load...
### Description Unify Changestore and Logstore for flink source ### Use case/motivation Arctic use Changestore and Logstore to store CDC messages. Logstore use MQ(eg: Kafka) to distribute real-time cdc message....
Now, keyed change table has 2 properties to control files change.data.ttl.minutes: check change table data file whether in valid time, if not then delete from iceberg snapshot snapshot.change.keep.minutes:check change table...
