LLaDA icon indicating copy to clipboard operation
LLaDA copied to clipboard

Could you provide the loss curve of sft?

Open yuecao0119 opened this issue 9 months ago • 3 comments

Hello,

Thank you for your excellent work. Could you provide the loss curve of sft? Because when I tried it myself, I found that the loss curve would fluctuate greatly, occasionally changing to 1 or 2, and sometimes to 0.0000.

yuecao0119 avatar Mar 20 '25 09:03 yuecao0119

+1

danielmisrael avatar Apr 10 '25 00:04 danielmisrael

Thank you all for your attention! I'm truly sorry that the loss curve of LLaDA SFT has been cleared because the company's cluster regularly cleans up the logs.

nieshenx avatar Apr 22 '25 11:04 nieshenx

Has it been resolved? My loss is also like this, it has never converged.

Eros1on-Aqua avatar Jun 24 '25 11:06 Eros1on-Aqua