neural_sp icon indicating copy to clipboard operation
neural_sp copied to clipboard

Aboult the warmup_n_steps and accum_grad_n_steps usd in Aishell

Open mlxu995 opened this issue 4 years ago • 1 comments

In the config transformer.yaml, "n_epochs=30, batch_size=32, warmup_n_steps=25000, accum_grad_n_steps=8". Under the above config, I got a learning rate curve which went straight up until the end of the training. And the result is not good as it reported in this project. I need assistance, really appreciate. @hirofumi0810 @boji123

mlxu995 avatar Sep 13 '20 12:09 mlxu995

I have never met such a situation. Did you modify the config file?

hirofumi0810 avatar Sep 22 '20 09:09 hirofumi0810