ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Feature Request]: Will you support Qwen3-Embedding model series?

Open eternalgogi92 opened this issue 6 months ago • 4 comments

Self Checks

  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (Language Policy).
  • [x] Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
  • [x] Please do not modify this template :) and fill in all the required fields.

Is your feature request related to a problem?


Describe the feature you'd like

I have reviewed the example code for Qwen3-Embedding inference and noticed it differs from BGE-M3. Do you plan to support this model in the near future?

Describe implementation you've considered

No response

Documentation, adoption, use case


Additional information

No response

eternalgogi92 avatar Jun 11 '25 02:06 eternalgogi92

@eternalgogi92 Definitely will.

ZhenhangTung avatar Jun 11 '25 03:06 ZhenhangTung

Related issue: https://github.com/infiniflow/ragflow/issues/8156

ZhenhangTung avatar Jun 11 '25 03:06 ZhenhangTung

There are three cases:

  1. If you deploy Qwen3-Embedding through other frameworks, it's easy because RAGFlow does not care what kind of embedding model is used actually.
  2. If what you wanted is to provide Qwen3-Embedding within RAGFlow package such that you can use the builtin support from RAGFlow embedding serving service, we do not have such a plan because it will introduce lots of extra dependencies. Actually, RAGFlow plan not to use any builtin embedding services in future.
  3. If you hope to use Qwen3-Embedding through some SaaS API, we will provide soon.

yingfeng avatar Jun 11 '25 04:06 yingfeng

Already in use VLLM_USE_MODELSCOPE=True vllm serve Qwen/Qwen3-Embedding-4B

nkh0472 avatar Jun 12 '25 04:06 nkh0472