ForeverAngry
ForeverAngry
@trungda I'm interested in this feature. Is this something you have solved?
> Yes you will need a catalog yaml to specify which catalog implementation you are using for the Iceberg source. If none is specified, it assumes you're not using an...
Sure. Also, I'm not really versed in writing java test. So I'm flying a bit blind here, in terms if those are correct or not. Any pointers would be appreciated....
> @ForeverAngry we've gone through some module renaming, can you pull in the latest changes from `main` to pick up the path changes? @the-other-tim-brown sure. Also, I don't have a...
> @MrDerecho to catalog with glue while running sync, you can look at this example: https://medium.com/@sagarlakshmipathy/using-onetable-to-translate-a-hudi-table-to-iceberg-format-and-sync-with-glue-catalog-8c3071f08877 @sagarlakshmipathy thanks for this info! If I'm running onetable in a docker container, do...
Maybe I'm doing something wrong here, but when I try to convert iceberg to delta using a glue catalog, I keep getting the error that the class constructor for catalog.Catalog...
> @ForeverAngry what is the error message you are seeing and how are you creating this docker image? @the-other-tim-brown Well, it was for sure an error with the image. But...
@the-other-tim-brown yeah I misspoke in my comment, you are correct, I'm using the hour transform.
@the-other-tim-brown yeah here is the error: `2024-03-05 20:30:06 ERROR io.onetable.spi.sync.TableFormatSync:78 - Failed to sync snapshot org.apache.spark.sql.AnalysisException: cannot resolve 'date_format(timestamp, 'yyyy-MM-dd-HH')' due to data type mismatch: argument 1 requires timestamp type,...
@the-other-tim-brown that's not the full stack trace, just the error. The machine the program is on is separate and not able to post here. So I have to type alot...