lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard

[Feature] support Qwen3 Embedding and Reranker

Open mj520 opened this issue 6 months ago • 1 comments

Motivation

lmdeploy serve api_server /root/Qwen3-Embedding--model-name Qwen3-Embedding run Qwen3 Embedding and Reranker ok

nomic-embed-text is not explicitly supported by lmdeploy.

Related resources

/v1/embeddings { "message": "Unsupported by turbomind.", "type": "invalid_request_error", "code": 400, "param": null, "object": "error" }

Additional context

/v1/rerank Not Found

mj520 avatar Jun 27 '25 02:06 mj520

+1

datalee avatar Aug 29 '25 07:08 datalee