lmdeploy
lmdeploy copied to clipboard
[Feature] support Qwen3 Embedding and Reranker
Motivation
lmdeploy serve api_server /root/Qwen3-Embedding--model-name Qwen3-Embedding run Qwen3 Embedding and Reranker ok
nomic-embed-text is not explicitly supported by lmdeploy.
Related resources
/v1/embeddings { "message": "Unsupported by turbomind.", "type": "invalid_request_error", "code": 400, "param": null, "object": "error" }
Additional context
/v1/rerank Not Found
+1