doris icon indicating copy to clipboard operation
doris copied to clipboard

[Feature](NGram BloomFilter Index) add new ngram bloom filter index to speed up like query

Open compasses opened this issue 3 years ago • 0 comments

Proposed changes

Issue Number: close #10733

Problem summary

Describe your changes.

This PR implement the new bloom filter index: NGram bloom filter index, which was proposed in #10733. The new index can improve the like query performance greatly, from our some test case , can get order of magnitude improve. For how to use it you can check the docs in this PR, and the index based on the enable_function_pushdown, you need set it to true, to make the index work for like query.

Checklist(Required)

  1. Does it affect the original behavior:
    • [ ] No
  2. Has unit tests been added:
    • [ ] Yes
  3. Has document been added or modified:
    • [ ] Yes
  4. Does it need to update dependencies:
    • [ ] No
  5. Are there any changes that cannot be rolled back:
    • [ ] No

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

compasses avatar Aug 07 '22 13:08 compasses