doris
doris copied to clipboard
[Feature](NGram BloomFilter Index) add new ngram bloom filter index to speed up like query
Proposed changes
Issue Number: close #10733
Problem summary
Describe your changes.
This PR implement the new bloom filter index: NGram bloom filter index, which was proposed in #10733.
The new index can improve the like query performance greatly, from our some test case , can get order of magnitude improve.
For how to use it you can check the docs in this PR, and the index based on the enable_function_pushdown, you need set it to true, to make the index work for like query.
Checklist(Required)
- Does it affect the original behavior:
- [ ] No
- Has unit tests been added:
- [ ] Yes
- Has document been added or modified:
- [ ] Yes
- Does it need to update dependencies:
- [ ] No
- Are there any changes that cannot be rolled back:
- [ ] No
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...