gravitino icon indicating copy to clipboard operation
gravitino copied to clipboard

[Bug report] Upgrade Iceberg version to 1.10.0 for GCP authentication support

Open hajunyoo1209 opened this issue 1 month ago • 3 comments

Version

main branch

Describe what's wrong

When using Iceberg 1.9.2 with GCP in Gravitino's Docker environment, GCS FileIO initialization fails due to missing GCP authentication dependencies. Iceberg 1.9.2's generic OAuth2Manager does not support:

Application Default Credentials (ADC) Service account JSON file authentication GCP authorization code workflow

This prevents proper GCP integration for Iceberg REST catalogs. Reference: apache/iceberg#13212 - GCP: Add Google Authentication Support

P.S: I can work around this issue by downloading iceberg-gcp-bundle-1.10.0 jar, but I am hoping for an official Iceberg version upgrade that includes this fix.

Error message and/or stacktrace

Cannot initialize FileIO implementation org.apache.iceberg.gcp.gcs.GCSFileIO: 
Cannot find constructor for interface org.apache.iceberg.io.FileIO 
Missing org.apache.iceberg.gcp.gcs.GCSFileIO 
[java.lang.NoClassDefFoundError: com/google/auth/Credentials]
Image

How to reproduce

gravitino 1.0.0

Additional context

Upgrade to Iceberg 1.10.0

File: dev/docker/gravitino/gravitino-dependency.sh line

Change from iceberg_version="1.9.2"

To iceberg_version="1.10.0"

hajunyoo1209 avatar Nov 02 '25 13:11 hajunyoo1209

I think this will be resolved once this link is merged

hajunyoo1209 avatar Nov 04 '25 01:11 hajunyoo1209

@FANNG1 Would you please help to confirm this?

mchades avatar Nov 06 '25 12:11 mchades

Any special configuration to reproduce NoClassDefFoundError com/google/auth/Credentials?

FANNG1 avatar Nov 07 '25 00:11 FANNG1

@hajunyoo1209 , Iceberg version is updated to 1.10, does this resolve your problem?

FANNG1 avatar Nov 28 '25 14:11 FANNG1

It resolved. Thanks for help @FANNG1.

hajunyoo1209 avatar Dec 01 '25 01:12 hajunyoo1209