incubator-xtable

incubator-xtable copied to clipboard

Docker Demo fails at Iceberg sync to Delta

5

code block ``` val icebergSourceClientProvider = new IcebergSourceClientProvider() icebergSourceClientProvider.init(spark.sparkContext.hadoopConfiguration, Collections.emptyMap()) val icebergSourcePerTableConfig = PerTableConfigImpl.builder() .tableName(hudiTableName) .namespace(namespaceArray) .targetTableFormats(Arrays.asList(TableFormat.DELTA)) .tableBasePath(hudiBasePath) .icebergCatalogConfig(icebergCatalogConfig) .syncMode(SyncMode.INCREMENTAL) .build() oneTableClient.sync(icebergSourcePerTableConfig, icebergSourceClientProvider) ``` error: ``` java.lang.NoSuchMethodError: org.apache.spark.sql.delta.actions.AddFile.(Ljava/lang/String;Lscala/collection/immutable/Map;JJZLjava/lang/String;Lscala/collection/immutable/Map;Lorg/apache/spark/sql/delta/actions/DeletionVectorDescriptor;)V org.apache.xtable.delta.DeltaDataFileUpdatesExtractor.createAddFileAction(DeltaDataFileUpdatesExtractor.java:118) org.apache.xtable.delta.DeltaDataFileUpdatesExtractor.lambda$applyDiff$3(DeltaDataFileUpdatesExtractor.java:99)...

sagarlakshmipathy

Website header add ASF menu

7

Website header add ASF menu

wuchunfu

Docker demo warning. RMI TCP Accept-0: accept loop for ServerSocket[addr=0.0.0.0/0.0.0.0,localport=35371] throws

2

``` presto | 2024-02-03T14:17:07.494Z WARN RMI TCP Accept-0 sun.rmi.transport.tcp RMI TCP Accept-0: accept loop for ServerSocket[addr=0.0.0.0/0.0.0.0,localport=35371] throws presto | java.net.SocketTimeoutException: Accept timed out presto | at java.base/java.net.PlainSocketImpl.socketAccept(Native Method) presto |...

alberttwong

trino | 2024-03-19T19:53:44.178Z ERROR main io.trino.server.Server No service providers of type io.trino.spi.Plugin in the classpath: [file:/data/trino/plugin/thrift/HdrHistogram-2.1.9.jar, file:/data/trino/plugin/thrift/aopalliance-1.0.jar, file:/data/trino/plugin/thrift/asm-9.6.jar, file:/data/trino/plugin/thrift/asm-analysis-9.6.jar, file:/data/trino/plugin/thrift/asm-tree-9.6.jar, file:/data/trino/plugin/thrift/asm-util-9.6.jar, file:/data/trino/plugin/thrift/bootstrap-235.jar, file:/data/trino/plugin/thrift/byte-buddy-1.14.8.jar, file:/data/trino/plugin/thrift/bytecode-1.5.jar, file:/data/trino/plugin/thrift/checker-qual-3.37.0.jar, file:/data/trino/plugin/thrift/classmate-1.5.1.jar, file:/data/trino/plugin/thrift/concurrent-235.jar, file:/data/trino/plugin/thrift/configuration-235.jar, file:/data/trino/plugin/thrift/drift-api-1.21.jar, file:/data/trino/plugin/thrift/drift-client-1.21.jar,...

yegangy0718

OneTable.dev Cannot be reached

2

Maybe its just me - but i think the website is down.

ForeverAngry

support ntz type

1

## *Important Read* - *Please ensure the GitHub issue is mentioned at the beginning of the PR* ## What is the purpose of the pull request *(For example: This pull...

the-other-tim-brown

Add Python wrappers or create interoperability to call the classes/methods using Python

4

Data engineers quite heavily rely on Python for creating data pipelines. Its important to support the ability to call the Java objects using Python (through Py4J or similar tools/libraries). Right...

sagarlakshmipathy

[Support] Request: Ability to Invoke Scala Code for Operations in oneTable

21

Hello, I hope this message finds you well. I'm currently in the midst of experimenting with oneTable and conducting some proof of concept work. As I delve deeper into this,...

soumilshah1995

## *Important Read* - *Please ensure the GitHub issue is mentioned at the beginning of the PR* ## What is the purpose of the pull request *(For example: This pull...

the-other-tim-brown

Unable to create delta log metadata files for Iceberg table

7

We have created iceberg data in a GCS bucket, which includes a 'data' folder and a 'metadata' folder. I am attempting to generate delta metadata after cloning the 'onetable' repository....

Manoranjan93