DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

[REQUEST] Any arguments for disabling saving global steps?

Open annopackage opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe. Global steps for optimizer states would be save each save_steps, which consume lots of time and memory.

Describe the solution you'd like I wonder if there is any arguments to disable saving global steps, and only save checkpoints for inference.

annopackage avatar May 04 '24 09:05 annopackage