ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard
Published 2 weeks ago • verified publisher icon infiniflow

Added LocalAI support for rerank models

Open shizzgar opened this issue 1 year ago • 0 comments

What problem does this PR solve?

Hi there! LocalAI added support of rerank models https://localai.io/features/reranker/

I've implemented LocalAIRerank class (typically copied it from OpenAI_APIRerank class). Also, LocalAI model response with 500 error code if len of "documents" is less than 2 in similarity check. So I've added the second "document" on RERANK model connection check in api/apps/llm_app.py.

Type of change

  • [x] New Feature (non-breaking change which adds functionality)

shizzgar avatar Nov 16 '24 00:11 shizzgar