pytorch-kaldi icon indicating copy to clipboard operation
pytorch-kaldi copied to clipboard

Can we resume training from the epoch we got interruption

Open sun-peach opened this issue 4 years ago • 4 comments

Hi, my computer's power was down and the experiment was interrupted at epoch 13. Can we resume the training from where it was interrupted?

Thank you.

sun-peach avatar Jul 31 '20 03:07 sun-peach

Well, yes. The model is stored each epoch. So if the training stops at epoch 13 (let's say at 50%) then it should restart at epoch 13 0%

TParcollet avatar Sep 02 '20 12:09 TParcollet

Thank you. But do we need to set some flag to do that or pytorch kaldi will do it automatically? @TParcollet

sun-peach avatar Mar 16 '21 05:03 sun-peach

My suggestion is to move to SpeechBrain though: https://speechbrain.github.io/ SpeechBrain is a new project which is much richer, easy-to-use, well-documented than the old pytorch-kaldi one.

On Tue, 16 Mar 2021 at 01:38, sun-peach @.***> wrote:

Thank you. But do we need to set some flag to do that or pytorch kaldi will do it automatically? @TParcollet https://github.com/TParcollet

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/mravanelli/pytorch-kaldi/issues/241#issuecomment-799966868, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEA2ZVWN2SHTXHOKYQLNYKTTD3VEHANCNFSM4PPJOSLQ .

mravanelli avatar Mar 16 '21 13:03 mravanelli

@mravanelli I have already noted that. I am doing research on that. Thank you.

sun-peach avatar Mar 20 '21 00:03 sun-peach