flax icon indicating copy to clipboard operation
flax copied to clipboard
verified publisher icon google

[NVIDIA] Rename fp8 custom dtype to `fp32_max_grad`

Open kaixih opened this issue 1 year ago • 0 comments

This PR renames the original fm32 to fp32_max_grad to express the idea of the dtype is used for storing fp32 values and using max for the gradient accumulation.

cc. @nouiz

kaixih avatar Jun 11 '24 20:06 kaixih