[Feature]CLIP support

Open yichuan-w opened this issue 4 months ago • 3 comments

https://github.com/yichuan-w/LEANN/tree/financebench/benchmarks/laion a hint example, but we need more support in apps, like RAG on all your imgs

Sep 09 '25 06:09 yichuan-w

Hey I Like to work On this Issue.

Nov 13 '25 16:11 patelchaitany

yeah, great! Feel free to propose a PR. We really need a PR related to multimodal like CLIP. Right now, we have https://github.com/yichuan-w/LEANN/pull/162 and https://github.com/yichuan-w/LEANN/blob/main/apps/multimodal/vision-based-pdf-multi-vector/multi-vector-leann-similarity-map.py

but these are more advanced multi vector. we still miss CLIP. thanks for that

Nov 13 '25 20:11 yichuan-w

@patelchaitany Please refer to #162 for some current updates on CLIP so we do not have duplicate work done, feel free to comment on the work there as well as edit to make CLIP more effective

Nov 18 '25 09:11 ASuresh0524