voca icon indicating copy to clipboard operation
voca copied to clipboard

question about the learning rate decay

Open brooks0519 opened this issue 3 years ago • 1 comments

Hello, Thanks for your great work, recently, I have do some work to replace deepspeech0.1.0 to adapt live audio streaming inference. So I retrain the voca model, but I found the learning rate is always 0.0001, I want to know have you ever use decay learning rate? and the effect of different learning rate? thanks again

brooks0519 avatar Aug 23 '22 10:08 brooks0519

No, we did not decay the learning rate and we did not investigate the effect of different learning rates. If you find some better training strategy, I would be happy to learn about it.

TimoBolkart avatar Aug 27 '22 13:08 TimoBolkart