lance icon indicating copy to clipboard operation
lance copied to clipboard

feat: integrate inverted index into lance index APIs

Open BubbleCal opened this issue 1 year ago • 1 comments

  • support to create inverted index
  • support to query with inverted index
  • python binding
  • push down limit roadmap: #1195

BubbleCal avatar Jul 09 '24 12:07 BubbleCal

Codecov Report

Attention: Patch coverage is 41.73765% with 342 lines in your changes missing coverage. Please review.

Project coverage is 78.99%. Comparing base (b45393e) to head (9dbd6b8).

Files Patch % Lines
rust/lance/src/io/exec/fts.rs 0.00% 104 Missing :warning:
rust/lance-index/src/scalar/inverted.rs 64.17% 86 Missing and 10 partials :warning:
rust/lance/src/dataset/scanner.rs 28.68% 84 Missing and 8 partials :warning:
rust/lance/src/io/exec/utils.rs 57.14% 0 Missing and 15 partials :warning:
rust/lance-index/src/scalar.rs 33.33% 14 Missing :warning:
rust/lance-index/src/scalar/bitmap.rs 0.00% 8 Missing :warning:
rust/lance/src/index/scalar.rs 30.00% 4 Missing and 3 partials :warning:
rust/lance-index/src/prefilter.rs 33.33% 6 Missing :warning:
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2577      +/-   ##
==========================================
- Coverage   79.35%   78.99%   -0.36%     
==========================================
  Files         213      215       +2     
  Lines       62521    62904     +383     
  Branches    62521    62904     +383     
==========================================
+ Hits        49614    49693      +79     
- Misses       9996    10302     +306     
+ Partials     2911     2909       -2     
Flag Coverage Δ
unittests 78.99% <41.73%> (-0.36%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov-commenter avatar Jul 09 '24 12:07 codecov-commenter

@westonpace @wjones127 Just moved the fts to a new FtsExec node, and block being with vector search for now

BubbleCal avatar Jul 19 '24 10:07 BubbleCal