byaldi
byaldi copied to clipboard
Use late-interaction multi-modal models such as ColPali in just a few lines of code.
hy can anyone know how to load the existing index from persitant directory means my indexses are stored in .byadli with index name subfolder so how i can load the...
Hi all - I've gotten this code to work in a RAG, but it is prohibitively slow even for a small number of documents (I have access to multiple A100s)....
I have CPU based windows system and while running the below code I get the "Torch not compiled with CUDA enabled error". Code:- RAG = RAGMultiModalModel.from_pretrained("vidore/colpali") Error:- --------------------------------------------------------------------------- AssertionError Traceback...
Hey, Thank you so much for your library! I’m nearly done preparing a practical session for my master's students using it. I was wondering if there's an easy way to...
## Description Add support for the ColSmol model family. Reference thread: https://x.com/tonywu_71/status/1882434084657590522. ## Changes ### Added - Add support for ColSmol model ### Tests - Add test for ColSmol model
I'm trying to run the example quick_overview.ipynb on m1 mbp. ```import os from dotenv import load_dotenv from pathlib import Path from byaldi import RAGMultiModalModel load_dotenv() # print(os.environ["HF_TOKEN"]) # Initialize RAGMultiModalModel...
Hello, Thank you for the amazing library. I referred the RAG implementation notebooks from hugging face using this library and loved it. I am just wondering if there is a...
Need to be able to set mmap=true for torch.load() for us humble people without very good computers. That is all. For those that need a Fix now just make your...
**Description:** When running the colqwen2 model on an MPS device (Apple Silicon), the default attention implementation causes compatibility issues. The fix ensures that attn_implementation="eager" is used when the device is...