kubni

Hello. I have the index saved to disk (4 json.gz files, and one embeddings_0.pt file). `from_index()` takes anywhere between 15-30 seconds, which seems like a long time, given that the...

Using DSPy with Qdrant and ColQwen2

8

Hello. I used `ColQwen2` model from Colpali team to generate embeddings and store them into my Qdrant database. I wanted to try out DSPy, but I can't get it to...

Wrong classification of title level

1

Hello. I m trying out marker-pdf and I noticed that it sometimes classifies title levels wrong. Here is how page 63 looks:  That title is classified as level 1....

Question: Is it possible to use Colqwen with vLLM?

5

vLLM should support Qwen models, but Colqwen isn't a simple Qwen fine-tune, so I am wondering whether someone used the two successfully.