LLMs-from-scratch icon indicating copy to clipboard operation
LLMs-from-scratch copied to clipboard

Published 20 hours ago • verified publisher icon rasbt

Qwen3 0.6b - context length

Open d-kleine opened this issue 4 months ago • 0 comments

Could you provide more details about how you determined the context length?

I found this information:

  • The 0.6b model seems to support only 32k (32,768) tokens https://qwenlm.github.io/blog/qwen3/#introduction https://huggingface.co/Qwen/Qwen3-0.6B/blob/main/README.md

d-kleine avatar Jun 20 '25 13:06 d-kleine