starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

Support nessie catalog

Open colagy opened this issue 1 year ago • 6 comments

Enhancement

https://projectnessie.org/

image

colagy avatar Jan 24 '24 03:01 colagy

+1

16bzwiener avatar Feb 07 '24 07:02 16bzwiener

+1

chulucninh09 avatar Mar 29 '24 16:03 chulucninh09

+1

margorczynski avatar Apr 09 '24 08:04 margorczynski

+1

chrisfw avatar May 16 '24 14:05 chrisfw

Nessie will have an integrated iceberg catalog, perhaps this will already support this use case:

https://projectnessie.org/blog/2024/05/13/nessie-integration-of-iceberg-rest/

mrhamburg avatar May 18 '24 23:05 mrhamburg

Thanks for the info, @mrhamburg , you are correct, I received confirmation that Nessie support for the iceberg rest spec should be released in a few weeks which is great news!

chrisfw avatar May 19 '24 00:05 chrisfw

I tried to integrate Nessie with Starrocks. but the databases don't show on Starrocks. But they do exists on Nessie

CREATE EXTERNAL CATALOG iceberg_nessie PROPERTIES ( "type" = "iceberg", "iceberg.catalog.type" = "rest", "iceberg.catalog.uri"="http://xxx.xxx.xxx.xxx:19121/iceberg/", "iceberg.catalog.warehouse"="warehouse", "aws.s3.enable_ssl" = "false", "aws.s3.enable_path_style_access" = "true", "aws.s3.endpoint" = "http://xxx.xxx.xxx.xxx:9000", "aws.s3.access_key" = "minioadmin", "aws.s3.secret_key" = "minioadmin" "client.factory"="com.starrocks.connector.iceberg.IcebergAwsClientFactory" );

StarRocks > set catalog iceberg_nessie; Query OK, 0 rows affected (0.00 sec)

StarRocks > create database uw2; Query OK, 0 rows affected (0.09 sec)

StarRocks > show databases; Empty set (0.03 sec)

the uw2 database does exists on Nessie. Perhaps there's something that I did wrong?

Valkyrie298 avatar Jul 30 '24 10:07 Valkyrie298

+1

MaheshSankaran avatar Sep 10 '24 08:09 MaheshSankaran

+1

dorsegal avatar Oct 07 '24 22:10 dorsegal

+1

akizminet avatar Oct 28 '24 12:10 akizminet

We have marked this issue as stale because it has been inactive for 6 months. If this issue is still relevant, removing the stale label or adding a comment will keep it active. Otherwise, we'll close it in 10 days to keep the issue queue tidy. Thank you for your contribution to StarRocks!

github-actions[bot] avatar Apr 28 '25 11:04 github-actions[bot]