hudi
hudi copied to clipboard
[HUDI-8110] Throw an error for time travel query on MDT
Change Logs
Spark datasource read on MDT (spark.read.format("hudi").option("as.of.instant", ..).load(mdt_base_path)) should throw an error indicating that this is not supported.
Impact
NA
Risk level (write none, low medium or high below)
low
Documentation Update
NA
Contributor's checklist
- [ ] Read through contributor's guide
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
CI report:
- 5c24340a813bb2ad749f9b602a707200cfb1e0c5 Azure: SUCCESS
Bot commands
@hudi-bot supports the following commands:@hudi-bot run azurere-run the last Azure build
@CTTY I think the time travel queries on MDT should be executed mainly for debugging purposes. The hudi components do not use time travel query on MDT.
We have the fix now, so closing this one.
The fix to time travel query on MDT: https://github.com/apache/hudi/pull/11860