cuvs icon indicating copy to clipboard operation
cuvs copied to clipboard

Fix IVF PQ build metric for CAGRA

Open lowener opened this issue 8 months ago • 8 comments

Related to #841. The IVF-PQ build metric is not properly initialized in the case of InnerProduct, so I am adding here correct initialization on the C layer, as well as some checks on the C++ side so that the CAGRA metric match the knn metric.

lowener avatar Apr 30 '25 16:04 lowener

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

copy-pr-bot[bot] avatar Apr 30 '25 16:04 copy-pr-bot[bot]

/ok to test 57aa341

cjnolet avatar Apr 30 '25 21:04 cjnolet

@lowener does this PR impacts the integration of Cuvs with Faiss library?

navneet1v avatar May 01 '25 19:05 navneet1v

@navneet1v Faiss is currently tied to libcuvs=25.04. Whatever goes in after 25.04 is not reflected in faiss until it upgrades to the latest cuVS version.

tarang-jain avatar May 02 '25 02:05 tarang-jain

@tarang-jain let me clarify what I am asking, question is: Is this bug present in 25.04 version of libcuvs which is present in faiss.

navneet1v avatar May 02 '25 09:05 navneet1v

Yes this was already present in libcuvs 25.04 @navneet1v

lowener avatar May 02 '25 17:05 lowener

@lowener should we create a PR in Faiss to upgrade Cuvs version in Faiss to fix the issue?

navneet1v avatar May 02 '25 18:05 navneet1v

Since Faiss just depends on a pre-installed version of cuVS and does not build cuVS from source, you should be able to simply install 25.06 after this PR is merged (or even build this PR branch from source) in your environment. So long as any of the public API signatures have not changed between 25.04 and 25.06, it will work just fine while building Faiss from source. For bumping up Faiss to RAPIDS version 25.06, yes it can be done since it is a simple version upgrade and that would change the faiss-gpu-cuvs conda package. However it might be safer to do it after the release (stable) and not with the cuVS nightlies unless there are crucial feature enhancements / bug fixes in the nightlies.

tarang-jain avatar May 02 '25 18:05 tarang-jain

/ok to test c620cc1

cjnolet avatar May 07 '25 15:05 cjnolet

@cjnolet by when we can expect this change to be merged? We are looking to test this with Faiss to see if the issue of recall is fixed.

navneet1v avatar May 07 '25 19:05 navneet1v

@navneet1v it should be merged for the 25.06 release (burndown is in 2 weeks). It'll likely be merged well before burndown, but it needs to pass CI first.

cjnolet avatar May 07 '25 21:05 cjnolet

/merge

benfred avatar May 08 '25 16:05 benfred