nebuly icon indicating copy to clipboard operation
nebuly copied to clipboard

Published 20 hours ago • verified publisher icon nebuly-ai

Add full support for offloading

Open diegofiori opened this issue 1 year ago • 0 comments

Description

DeepSpeed supports offloading during training using the Zero-Infinity technology. We should add examples of working configuration files for the models we support.

TODO

  • [ ] Add examples of config files using Zero-Inifinty
  • [ ] Add Off-loading section in the documentation

diegofiori avatar Mar 08 '23 13:03 diegofiori