cuvs icon indicating copy to clipboard operation
cuvs copied to clipboard

[Feat] CAGRA filtering with BFKNN when sparsity matching threshold

Open rhdong opened this issue 1 year ago • 0 comments

  • Reopen for rebasing the new prefilter API
  • Restriction: This feature only supports the contiguous device dataset, and float32 or half distance type
  • Related to: https://github.com/rapidsai/cuvs/issues/252
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Type    Queries  n_rows   Dim   K     Metric         Layout    BruteF/Cagra    Sparsity     Recall rate (%)   Search Time (ms)   Build Time (ms)    Total Time (ms)    Throughput (q/s)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
float   100      1048576  32    64    InnerProduct   row       Brute           0.100        100.000           4.041              15891.638          15895.679          6.291
float   100      1048576  32    64    InnerProduct   row       Cagra           0.100         69.922           0.825              16162.612          16163.438          6.187
                                                                                                                                                    
float   100      1048576  32    64    InnerProduct   row       Brute           0.300        100.000           4.216              16265.309          16269.525          6.146
float   100      1048576  32    64    InnerProduct   row       Cagra           0.300         67.547           0.857              16227.900          16228.758          6.162
                                                                                                                                                    
float   100      1048576  32    64    InnerProduct   row       Brute           0.500        100.000           4.285              16110.632          16114.916          6.205
float   100      1048576  32    64    InnerProduct   row       Cagra           0.500         64.344           0.881              15642.374          15643.255          6.393
                                                                                                                                                    
float   100      1048576  32    64    InnerProduct   row       Brute           0.800        100.000           4.268              16707.514          16711.783          5.984
float   100      1048576  32    64    InnerProduct   row       Cagra           0.800         37.547           1.312              20631.773          20633.085          4.847
                                                                                                                                                    
float   100      1048576  32    64    InnerProduct   row       Brute           0.900        100.000           4.149              16323.327          16327.475          6.125
float   100      1048576  32    64    InnerProduct   row       Cagra           0.900         20.703           0.887              16195.060          16195.947          6.174
                                                                                                                                                    
float   100      1048576  32    64    InnerProduct   row       Brute           0.990        100.000           5.542              20701.861          20707.403          4.829
float   100      1048576  32    64    InnerProduct   row       Cagra           0.990          2.391           0.942              17216.771          17217.714          5.808

rhdong avatar Oct 02 '24 19:10 rhdong