WrenAI icon indicating copy to clipboard operation
WrenAI copied to clipboard

compatible qwen3 think and no_think

Open flyrun9527 opened this issue 7 months ago • 4 comments

compatible qwen3 think and no_think

flyrun9527 avatar Apr 29 '25 18:04 flyrun9527

I'll label this as good first issue. See if anyone are interested for contribution, the end result is a config example file for setting up qwen3 models.

Examples are here: https://github.com/Canner/WrenAI/tree/main/wren-ai-service/docs/config_examples

cyyeh avatar Apr 30 '25 00:04 cyyeh

Since qwen3 is a mixed thinking model of the same model, how should this model be configured @cyyeh

flyrun9527 avatar Apr 30 '25 04:04 flyrun9527

@flyrun9527

We are using litellm under the hood, so I suggest you check if litellm supports qwen3 models first.

cyyeh avatar Apr 30 '25 05:04 cyyeh

@flyrun9527 someone just contributed open-router config example! qwen3 is available via open-router, I suggest you try open-router first!

https://github.com/Canner/WrenAI/blob/main/wren-ai-service/docs/config_examples/config.open_router.yaml

cyyeh avatar May 02 '25 02:05 cyyeh

@flyrun9527 someone contributed qwen3 using open-router! please take a look at the config example: https://github.com/Canner/WrenAI/blob/main/wren-ai-service/docs/config_examples/config.qwen3.yaml

Also you could check relevant documentation here: https://github.com/Canner/WrenAI/tree/main/wren-ai-service/docs/config_examples#qwen3-think-and-no_think-configuration

cyyeh avatar Jun 03 '25 02:06 cyyeh

I'll close the issue now, please reopen it if you found any issues.

cyyeh avatar Jun 03 '25 02:06 cyyeh