seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Feature][Catalog] Catalog API Upgrade Feature

Open Jetiaime opened this issue 9 months ago • 0 comments

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

I'm rewrting SeaTunnel-Web for some reason, I found that there is not necessary to have datasource in the Web Project, we can just using Catalog instead, but I got some problems when I using Catalog:

  1. jdbc connector is so special that i have to split it to multi connector for different catalog, can we make sure one catalog to one connector? There will be more easy for writing catalog related service.
  2. I cannot get TableSchema when I have unsupported Column Type. There will be better if we just record it in the column and let the user know there cannot be selected.

I'm thinking of making catalog not only for the inside of seatunnel, but as a service that can be requested. So we can cut all the metadata service off and just be a client to seatunnel engine.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

Jetiaime avatar Apr 29 '24 07:04 Jetiaime