cvt2distilgpt2 icon indicating copy to clipboard operation
cvt2distilgpt2 copied to clipboard

Training loss consultation

Open yihp opened this issue 1 year ago • 3 comments

Hi,
I would like to ask what value the training loss finally converges to. Thank you.

yihp avatar May 15 '24 02:05 yihp

Hi @yihp,

For which dataset? What values are you getting?

Thanks, A.

anicolson avatar May 15 '24 02:05 anicolson

I'm testing it on my own dataset now, thanks for your reply!

yihp avatar May 15 '24 02:05 yihp

Your loss curve can depend on many factors, including your dataset, as I am sure you are aware 😀. If you would like you could share your loss curve. More telling would be your metric scores if you would like to share them as well.

anicolson avatar May 15 '24 02:05 anicolson