refact icon indicating copy to clipboard operation
refact copied to clipboard

Support Qwen3 models

Open alexkramer98 opened this issue 7 months ago • 2 comments

Hi!

Any plans to support Qwen3 models (both MoE and dense)?

alexkramer98 avatar May 16 '25 14:05 alexkramer98

@alexkramer98 we already have support for it in enterpise (using vllm). Probably we'll move vllm into OSS version of the server in the future.

mitya52 avatar Jun 02 '25 08:06 mitya52

Hey @alexkramer98 In case you wish to add any new models feel free to check our contribution guide here

avie66 avatar Jun 24 '25 09:06 avie66