debezium-server-iceberg icon indicating copy to clipboard operation
debezium-server-iceberg copied to clipboard

Published 20 hours ago • verified publisher icon memiiso

Any example of tool or program that read data that genereated from ice berg

Open deaw0003 opened this issue 1 year ago • 2 comments

Any example of tool or program that read table/data in s3 bucket that genereated from iceberg in upsert mode ?

deaw0003 avatar Aug 18 '22 03:08 deaw0003

@deaw0003 This is spark example reading s3(minio) data . its used for integration test. Here you can see more details how to use spark to read iceberg table.

If you are working with S3 i recommend configuring iceberg-consumer to use Glue Catalog. With Glue Catalog you can read the data using Spark, AWS Glue Job or AWS Athena.

ismailsimsek avatar Aug 18 '22 10:08 ismailsimsek

Thank you very much.

deaw0003 avatar Aug 19 '22 03:08 deaw0003