DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Syncing FusedAdam with new Apex features

Open jomayeri opened this issue 1 year ago • 0 comments

Apex added bf16 to FusedAdam, syncing DeepSpeed's FusedAdam to also support bf16. Based on this request.

Fix #3006

jomayeri avatar May 03 '23 18:05 jomayeri