TransformerEngine
TransformerEngine copied to clipboard
FP4 Training
Hi!
Wondering if there is any plan to support FP4 training in transformer engine. Would be great if so!
Thanks!