debezium-server-iceberg icon indicating copy to clipboard operation
debezium-server-iceberg copied to clipboard

Published 20 hours ago • verified publisher icon memiiso

Iceberg Metadata Catalog Config

Open fritzwijaya opened this issue 2 years ago • 7 comments

How to set the catalog implementation? Is there any docs for reference to set the config for supported metadata catalog?

fritzwijaya avatar Jan 20 '23 04:01 fritzwijaya

@fritzwijaya its explained in the last config line

and example config is here

ismailsimsek avatar Jan 20 '23 08:01 ismailsimsek

Thanks. Would take a look at it.

fritzwijaya avatar Jan 20 '23 08:01 fritzwijaya

@ismailsimsek does it support to use Glue metadata catalog?

fritzwijaya avatar Mar 28 '23 10:03 fritzwijaya

@fritzwijaya yes it supports it you just need to configure the catalog with your deployment. please feel free to post it here if you get any issue.

ismailsimsek avatar Mar 28 '23 10:03 ismailsimsek

@ismailsimsek could you please share the sample config for set catalog impl?

fritzwijaya avatar Mar 28 '23 11:03 fritzwijaya

@fritzwijaya glue catalog config should look like something below. additionally please make sure you have all the libraries and necessary access to glue

debezium.sink.iceberg.catalog-name=my_catalog
debezium.sink.iceberg.catalog-impl=org.apache.iceberg.aws.glue.GlueCatalog
debezium.sink.iceberg.warehouse=s3a://my-bucket/iceberg_warehouse
debezium.sink.iceberg.io-impl=org.apache.iceberg.aws.s3.S3FileIO

ismailsimsek avatar Mar 28 '23 11:03 ismailsimsek