hudi icon indicating copy to clipboard operation
hudi copied to clipboard

[HUDI-6207] spark support bucket index query for table with bucket index

Open KnightChess opened this issue 1 year ago • 11 comments

Change Logs

spark support query filter use bucket field if a bucket table query with appropriate expression( = 、in、and、or)

Impact

impore table query performance when use spark

Risk level (write none, low medium or high below)

low

Documentation Update

None

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

KnightChess avatar Nov 28 '23 07:11 KnightChess

@hudi-bot run azure

KnightChess avatar Dec 27 '23 14:12 KnightChess

@hudi-bot run azure

KnightChess avatar Jan 04 '24 14:01 KnightChess

@hudi-bot run azure

KnightChess avatar Jan 05 '24 02:01 KnightChess

@hudi-bot run azure

KnightChess avatar Jan 05 '24 06:01 KnightChess

@voonhous hi, I have made some modifications according to your suggestions @danny0405 I have support multiple hash fields according to your advice. If you have other questions or suggestions, I will be very happy to adjust further

KnightChess avatar Jan 05 '24 14:01 KnightChess

@hudi-bot run azure

KnightChess avatar Jan 11 '24 07:01 KnightChess

@hudi-bot run azure

KnightChess avatar Jan 11 '24 13:01 KnightChess

@nsivabalan @danny0405 @yihua hi, ci all sucess, can you help revie it.

KnightChess avatar Jan 22 '24 14:01 KnightChess

@KnightChess Is this patch ready for review again?

danny0405 avatar May 17 '24 09:05 danny0405

@danny0405 yes, is ready for review

KnightChess avatar May 17 '24 12:05 KnightChess

@hudi-bot run azure

KnightChess avatar May 20 '24 05:05 KnightChess

CI report:

  • d404396954992d5baa2499715705445e3f5d82f1 Azure: FAILURE
  • 1528c7b13bfe56dfb5f0a1527e628508915d32d5 Azure: PENDING
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar May 20 '24 06:05 hudi-bot