Michael Feil comments

Results 175 comments of


                                            Michael Feil

trafficstars

Reranker API “top_k” Support

https://docs.cohere.com/reference/rerank is supported - why would you need it? I personally see that you can do this in two lines of code client side.

Reranker API “top_k” Support

@etwk Your instructions are not clear. Please deploy, e.g. https://huggingface.co/mixedbread-ai/mxbai-rerank-xsmall-v1 via `infinity_emb v2 —model-id mixedbread-ai/mxbai-rerank-xsmall-v1`

@aloababa Can you align this implementation to one of the following API protocols? https://docs.voyageai.com/reference/reranker-api {return_documents: bool = False} {.., documents: str} https://jina.ai/reranker/ {return_documents: bool = False} -> {.., documents: str}...

ColQwen on RunPOD. ValueError: The checkpoint you are trying to load has model type `paligemma` but Transformers does not recognize this architecture.

Politely closing, as this issue should be opened in the Runpod serverless repo! infinity can handle this already, but serverless reimplements the api itself and has no support for multimodal!

add reranker model support for python backend

It would be exciting to work on this. I would be available to pick it up too. #449