[HUDI-7939] Validate file slices upto last completed commit in HoodieTableMetadataValidator

[lokeshj1703]

Change Logs

Currently HoodieTableMetadataValidator validates all the available file slices and compares the metadata table fs view against filesystem based fs view. The jira aims to use last completed instant and query the views using this instant for comparison.

Impact

NA

Risk level (write none, low medium or high below)

low

Documentation Update

NA

Contributor's checklist

• [ ] Read through contributor's guide
• [ ] Change Logs and Impact were stated clearly
• [ ] Adequate tests were added if applicable
• [ ] CI passed

[hudi-bot]

CI report:

• 586d6484e181ca34d743ba1e3ca52cd3aabce81a Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build