OneTrainer icon indicating copy to clipboard operation
OneTrainer copied to clipboard

added Skip Save interval before automatic saving starts

Open dxqbYD opened this issue 4 months ago • 6 comments

Automatic saving is used to have multiple checkpoints after training, so you can choose the best one. However, you know in advance that the first x000 steps will not be the best one. This PR adds a function to skip saving in those first x000 steps.

This example saves every 500 steps, but not within the first 3000:

grafik

Especially useful for full finetunes with large file sizes. The first few checkpoints waste both disk space and the time it takes to save.

dxqbYD avatar Sep 29 '24 21:09 dxqbYD