ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

Fix: CoHereRerank not respecting base_url when provided

Open hekmon opened this issue 10 months ago • 0 comments

What problem does this PR solve?

vLLM provider with a reranking model does not work : as vLLM uses under the hood the CoHereRerank provider with a base_url, if this URL is not passed to the Cohere client any attempt will endup on the Cohere SaaS (sending your private api key in the process) instead of your vLLM instance.

Type of change

  • [x] Bug Fix (non-breaking change which fixes an issue)
  • [ ] New Feature (non-breaking change which adds functionality)
  • [ ] Documentation Update
  • [ ] Refactoring
  • [ ] Performance Improvement
  • [ ] Other (please describe):

hekmon avatar Mar 07 '25 15:03 hekmon