hudi icon indicating copy to clipboard operation
hudi copied to clipboard

[HUDI-8110] Throw an error for time travel query on MDT

Open lokeshj1703 opened this issue 1 year ago • 2 comments

Change Logs

Spark datasource read on MDT (spark.read.format("hudi").option("as.of.instant", ..).load(mdt_base_path)) should throw an error indicating that this is not supported.

Impact

NA

Risk level (write none, low medium or high below)

low

Documentation Update

NA

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

lokeshj1703 avatar Aug 23 '24 12:08 lokeshj1703

CI report:

  • 5c24340a813bb2ad749f9b602a707200cfb1e0c5 Azure: SUCCESS
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Aug 26 '24 06:08 hudi-bot

@CTTY I think the time travel queries on MDT should be executed mainly for debugging purposes. The hudi components do not use time travel query on MDT.

lokeshj1703 avatar Aug 26 '24 06:08 lokeshj1703

We have the fix now, so closing this one.

yihua avatar Aug 29 '24 23:08 yihua

The fix to time travel query on MDT: https://github.com/apache/hudi/pull/11860

yihua avatar Aug 29 '24 23:08 yihua