Qwen3-Coder icon indicating copy to clipboard operation
Qwen3-Coder copied to clipboard

max_new_token max value for Qwen2.5-Coder Instruct?

Open Thireus opened this issue 1 year ago • 0 comments

It is there for Qwen2.5: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct mentions "Context Length: Full 131,072 tokens and generation 8192 tokens", so 8K.

But not for Qwen2.5-Coder…

https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct only mentions "Context Length: Full 131,072 tokens" and nothing about how many tokens max it can produce.

I cannot find the info anywhere… what is the max value of max_new_token for the Qwen2.5-Coder Instruct releases?

Thireus avatar Nov 15 '24 08:11 Thireus