faiss icon indicating copy to clipboard operation
faiss copied to clipboard

QINCo implementation in CPU Faiss

Open mdouze opened this issue 1 year ago • 19 comments

Summary: This is a straightforward implementation of QINCo in CPU Faiss, with encoding and decoding capabilities (not training).

For this, we translate a simplified version of some torch classes:

  • tensors, restricted to 2D and int32 + float32

  • Linear and Embedding layer

Then the QINCoStep and QINCo can just be defined as C++ objects that are copy-constructable.

There is some plumbing required in the wrapping layers to support the integration. Pytroch tensors are converted to numpy for getting / setting them in C++.

Differential Revision: D59132952

mdouze avatar Jul 02 '24 20:07 mdouze

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 02 '24 20:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 02 '24 21:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 08:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 09:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 09:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 10:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 12:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 13:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 14:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 05 '24 14:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 08 '24 07:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 08 '24 08:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 08 '24 08:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 08 '24 14:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 08 '24 15:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 08 '24 15:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 10 '24 08:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 10 '24 16:07 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D59132952

facebook-github-bot avatar Jul 10 '24 16:07 facebook-github-bot

This pull request has been merged in facebookresearch/faiss@dd72e4121dc6684c6fbf289949ba4526a54d9f3b.

facebook-github-bot avatar Jul 11 '24 09:07 facebook-github-bot