InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

[Feature] Colbert(ColPali-like) support

Open VoVAllen opened this issue 1 year ago • 1 comments

Motivation

https://github.com/illuin-tech/colpali

Recently Colbert+PaliGemma showed huge improvement on pdf file retrieval by using multimodal model instead of OCR+LLM. Would be nice if InternVL can support Colbert-like usage for downstream retrieval tasks.

Related resources

No response

Additional context

No response

VoVAllen avatar Jul 24 '24 18:07 VoVAllen

Hi, thanks for your advice.

czczup avatar Jul 30 '24 13:07 czczup