Tim Moon

icon company @NVIDIA icon location Performance engineer @NVIDIA

Results 227 comments of Tim Moon

Installing TE is so hard.

https://github.com/NVIDIA/TransformerEngine/issues/355#issuecomment-2394353816

Fix param input order for cudagraph

/te-ci pytorch

[PyTorch] Support dtype casting in fused adam

/te-ci pytorch

[PyTorch] Support dtype casting in fused adam

/te-ci pytorch

[PyTorch] Support dtype casting in fused adam

Based on a discussion with @ptrendx, I think we should give more thought to the API. While this is primarily targeting Megatron-LM, it's important that other TE users can use...

[PyTorch] Support dtype casting in fused adam

/te-ci pytorch

[PyTorch] Support dtype casting in fused adam

/te-ci pytorch