tensorflow-wavenet icon indicating copy to clipboard operation
tensorflow-wavenet copied to clipboard

Published 20 hours ago • verified publisher icon ibab

How to stop and resume training

Open Traincraft101 opened this issue 5 years ago • 2 comments

Do you have to do anything specific to stop the training if you want to test the model? can I just close the command prompt? How do you resume training when you stop it?

Traincraft101 avatar Nov 14 '19 16:11 Traincraft101

To stop usually I just kill . To restore you have to use the argument --restore_from and appoint the last version of yout model at the logdir folder.

SerafimC avatar Apr 20 '20 18:04 SerafimC

I tried this, but I am seeing no indication that it worked. The step number reset back at 0 and the loss shot back up to early training levels.

thejonathanvancetrance avatar Sep 24 '20 18:09 thejonathanvancetrance