yjzhong89

hi @cbalioglu, when will this feature be released? By the way, can I use deepspeed to train seamless communication model?

> CUDA 12.9 has been released on May 1st. https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#cublas-release-12-9 > > > We have added support for new scaling modes on Hopper (sm_90), including outer vector (per-channel/per-row), per-128-element, and...