Sagar Lakshmipathy

I'm seeing this on Q95 ``` 24/03/14 22:20:30 ERROR YarnScheduler: Lost executor 7 on ip-10-0-105-199.us-west-2.compute.internal: Container from a bad node: container_1710430554799_0011_01_000013 on host: ip-10-0-105-199.us-west-2.compute.internal. Exit status: 134. Diagnostics: /03/14 22:20:17...

| Query ID | Gluten Velox Spark Hudi (ms) | OSS Spark Hudi | |----------|------------------|----------------| | 1 | 22040 | 16699 | | 2 | 60531 | 33095 | |...

could resolve merge conflict - so raised this https://github.com/apache/hudi/pull/10940

You're right @bkvarda , I have noticed that snowflake writes the metadata file with the epoch ts. For the actual issue: Can you provide me with minimal steps to reproduce...

@bkvarda thanks for the explanation. I was able to replicate this issue. Breaking this down further, the issue itself has nothing to with Databricks. Its more of OneTable not liking...

As we are looking into more robust options to get this working. One workaround (super hacky) that I tested to get this to work is as follows: 1. Copy the...

@bkvarda @the-other-tim-brown These configs worked for me. `config.yaml` ``` sourceFormat: ICEBERG targetFormats: - DELTA datasets: - tableBasePath: s3:///snowflake_created/test_people tableDataPath: s3:///snowflake_created/test_people/data tableName: test_people namespace: onetable_testing.public ``` `catalog.yaml` ``` catalogImpl: org.apache.iceberg.snowflake.SnowflakeCatalog catalogName:...

@alberttwong can you provide the link for the killercode env you're referring to? we want to stick to something interactive and Jupyter notebook works great for that.

Two things I noticed while trying with `hudi 0.14.1` When I initially hit the `.save()` method I get this error ``` java.lang.NoSuchFieldError: SET_NULL_FOR_MISSING_COLUMNS at org.apache.hudi.DataSourceWriteOptions$.(DataSourceOptions.scala:540) at org.apache.hudi.DataSourceWriteOptions$.(DataSourceOptions.scala) at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:146) at...

@MrDerecho to catalog with glue while running sync, you can look at this example: https://medium.com/@sagarlakshmipathy/using-onetable-to-translate-a-hudi-table-to-iceberg-format-and-sync-with-glue-catalog-8c3071f08877