FastSpeech2 icon indicating copy to clipboard operation
FastSpeech2 copied to clipboard

Published 20 hours ago • verified publisher icon ming024

Fluctuating training loss

Open 299792459b opened this issue 1 year ago • 2 comments

image

Red is training loss Orange is valid loss

Other datasets show same behavior

Training loss fluctuates up and down drastically. Anyone know why is this happening? Thank you

299792459b avatar Aug 21 '23 05:08 299792459b

Try lowering learning rate.

melodyze-ai avatar Oct 01 '23 09:10 melodyze-ai

Try lowering learning rate.

which parameter in config is actually LR?

asarsembayev avatar Apr 22 '24 16:04 asarsembayev