Firefly icon indicating copy to clipboard operation
Firefly copied to clipboard

Published 20 hours ago • verified publisher icon yangjianxin1

qwen2 pretrain loss非常大

Open ucaslei opened this issue 4 months ago • 0 comments

qwen2 pretrain loss非常大，不知道什么问题，10点多，用llama-factory就没有这个问题，float32和bf16都试了，还是无法解决

ucaslei avatar Sep 28 '24 07:09 ucaslei