DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

[BUG] Train loss did not decrease during sft train process, help! Thx!

Open Modas-Li opened this issue 1 year ago • 1 comments

image

image

Modas-Li avatar Apr 27 '23 01:04 Modas-Li

I encounter the same issue using ds stage 3. Did you resolve this issue?

haorannlp avatar May 02 '23 06:05 haorannlp