hudi
hudi copied to clipboard
[SUPPORT]create hive table on top of existing hudi table
I have a spark job which runs weekly and writes output to hudi table.Hive sync is not enabled currently. This job has been running for last 4 months. Now I want to create a hive table on top of the existing hudi table.
If I add hive sync properties in the hudi write in my job now is it going to create hive table and show existing data? If not what could be the possible solution.
Thanks in advance.
Environment AWS EMR 6.5 HUDI 0.13 SPARK 3.3.4
Just enable the hive sync would work, but because you enabled the hive sync all of a sudden, there might be too much metadata to sync which is a pressure for Hive(would be slow).
@ayan2k21 Let us know if you were able to enable hive sync and get the desired output. Let us know in case of any issues. Thanks.
It worked. Job took little loner to run but all data is now visible in hive table.Thanks
Great! Thanks for the update.