vsearch icon indicating copy to clipboard operation
vsearch copied to clipboard

[Feature]: Unify and Relocate the Index and Search Module to the Retrieval Layer

Open jzhoubu opened this issue 5 months ago • 0 comments

  1. Integration of dense and sparse pipeline

Combine the dense and sparse pipelines (indexing, searching, evaluation) into a single unified pipeline within retriever module. Currently, the only difference between sparse and desne pipelines is the type of the index and search function, which should be determined when a specific retrieval architecture is chosen. In the future, I will prioritize sparse functions, with dense functions only serving as references.

  1. Reorganization of index and search modules

Will relocate index and search modules into the retrieval module to for easy-usability. These components are currently located in the example directory.

  1. Removal of replication parts for academic

Future academic replication efforts will be relocated to a separate repository for clarity in the main project.

jzhoubu avatar Sep 05 '24 06:09 jzhoubu