Is it possible to display an intermediate image of the training process, or to restart training again from the intermediate process?

Open gaoming714 opened this issue 1 year ago • 1 comments

Excuse me, is it possible to display an intermediate image of the training process, or to restart training again from the intermediate process? I'd like to be able to pause the pipe so that I can do other things in the middle of the process (like getting a new coat) and thus reduce the overall build time.

Jun 05 '24 09:06 gaoming714

Yep. Just save checkpoints and set resume_from_checkpoint in your training script to restart training.

Jun 12 '24 02:06 levihsu