Support `Qwen3ForCausalLM`

Open tomtaylor opened this issue 8 months ago • 2 comments

https://huggingface.co/Qwen/Qwen3-Embedding-0.6B is a great model for fast text embeddings, and there's a range of other Qwen3 models. It'd be great to add support for these.

https://huggingface.co/docs/transformers/main/en/model_doc/qwen3

Jun 16 '25 10:06 tomtaylor

Support for Qwen3ForCausalLM would be great indeed - also my use case is more in the space of getting high quality structured output using https://huggingface.co/osmosis-ai/Osmosis-Structure-0.6B .

Jun 22 '25 17:06 udoschneider

I started a draft pr! looking promising.

Oct 05 '25 22:10 nyo16