Qwen2.5 icon indicating copy to clipboard operation
Qwen2.5 copied to clipboard

Published 20 hours ago • verified publisher icon QwenLM

sft 7B model_max_length=90000 24 A00 OOM

Open gk-cv opened this issue 7 months ago • 2 comments

参考这里https://qwen.readthedocs.io/zh-cn/latest/training/SFT/example.html脚本

使用 24张A100，对7B sft，model_max_length超过2w时，OOM

gk-cv avatar Jul 18 '24 06:07 gk-cv