Ashish Garg

Results 30 comments of Ashish Garg

@kbendick yeah I lost access to HMS. But I have access to the warehouse folder in the s3 with data and metadata folders for all the tables generate by iceberg....

Icreated a local catalog and trying to register a table I get not supported error I am on spak 3.3 and iceberg 0.14 spark.sql("CALL local.system.register_table('table','s3a://test/')").show() java.lang.UnsupportedOperationException: Registering tables is not...

not able to find the artifactory location for nightly build. Could you please point me to that.

Thanks I was able to test it out one issue is if I move the data backed by s3 bucket in a DR location and try to recreate it the...

@dennishuo Thanks for this options spark.read.format("iceberg").load(iceberg_path).createOrReplaceTempView("my_view") 1) I tried this yesterday for my use case but getting version hint file missing issue. We are using s3 as storage 2) when...

Just seen this thread https://github.com/apache/iceberg/issues/1617

Can we use migrate_table procedure for this to specify the s3 path that points to the destination location

@singhpk234 s3 access points are still region specific Access point ARNs use the format arn:aws:s3:region:account-id:accesspoint/resource When we enable --conf spark.sql.catalog.test.s3.access-points.my-bucket1=arn:aws:s3::123456789012:accesspoint:mfzwi23gnjvgw.mrap \ --conf spark.sql.catalog.test.s3.access-points.my-bucket2=arn:aws:s3::123456789012:accesspoint:mfzwi23gnjvgw.mrap Does it use my-bucket1while writing the data...

@singhpk234 so just to understand it correctly we will define two buckets for cross region --conf spark.sql.catalog.test.s3.access-points.my-bucket1=arn:aws-reigon1 --conf spark.sql.catalog.test.s3.access-points.my-bucket2=arn:aws:s3-reigon2 and iceberg take care of replicating it across region. Reigon1 meta...

nessie-quarkus-0.43.0-runner.jar nessie-spark-extensions-3.3_2.12-0.43.0.jar I have kept the jar in the spark/jar folder I start the server with runner https://projectnessie.org/ Powered by Quarkus 2.12.2.Final 2022-10-12 13:57:59,475 WARN [io.qua.oid.com.run.OidcCommonUtils] (vert.x-eventloop-thread-1) OIDC Server is...