ms-swift
ms-swift copied to clipboard
Supporting ColPali Engine for Late Integration Embedding/Reranking models
Describe the feature Late Interaction training pradigm has become widely popular and well accepted in the community. We should enable/integrate - https://github.com/illuin-tech/colpali among the pioneers for embedding and reranking models with late interaction.
This would include adding support for VisBert and other Colpali models and their finetuning/experiments