torchtitan icon indicating copy to clipboard operation
torchtitan copied to clipboard
verified publisher icon pytorch

How to pretrain from scratch a Qwen 2.5 7B-base model using Torchtitan?

Open tjoymeed opened this issue 7 months ago • 0 comments

HI team,

Thank you for the excellent work!

Could you please tell me where to find example scripts/templates for pretraining from scratch a Qwen 2.5 7B-base model using Torchtitan?

Thanks again!

tjoymeed avatar May 25 '25 00:05 tjoymeed