paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[core][spark]support format table create, and implement format table for SparkCatalog

Open adrian-wang opened this issue 1 year ago • 4 comments

Purpose

Support format table creation, and add an implementation of format table for SparkCatalog.

Tests

Added SparkCatalogWithHiveTest

API and Format

No API changed.

Documentation

https://cwiki.apache.org/confluence/display/PAIMON/PIP-27%3A+Introduce+Format+Table+in+Paimon+Catalog

adrian-wang avatar Sep 19 '24 14:09 adrian-wang

See https://github.com/apache/paimon/pull/4243 , I think we can use this type to identify a format table.

JingsongLi avatar Sep 24 '24 03:09 JingsongLi

Support jdbc catalog?

melin avatar Sep 24 '24 07:09 melin

@melin need to extend jdbc table def before support it.

adrian-wang avatar Sep 24 '24 08:09 adrian-wang

@melin need to extend jdbc table def before support it.

After the jdbc catalog is supported, the hive metastore can be replaced.

melin avatar Sep 24 '24 12:09 melin