amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Feature]: Support loading mixed catalog without AMS dependency

Open zhoujinsong opened this issue 1 year ago • 0 comments

Description

Support loading mixed format catalog without the AMS dependent.

Use case/motivation

At the current stage, we have supported creating mixed format tables on any metastore service. However, loading the mixed format catalog still relies on obtaining catalog metadata from AMS, which means that accessing mixed format tables in the engine must depend on AMS, significantly limiting the use of the mixed format.

We should support loading mixed format catalog without the AMS dependent.

Describe the solution

We can refer to the Iceberg catalog to allow all metadata to be configured from the engine side, thereby avoiding a mandatory dependency on AMS.

Subtasks

  • [x] #3189
  • [x] #3210

Related issues

No response

Are you willing to submit a PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

zhoujinsong avatar Sep 10 '24 07:09 zhoujinsong