DeepSpeed
DeepSpeed copied to clipboard
Triangular mask support for Transformer kernel
Adding the new version of SoftMax for Transformer kernel to support Triangular mask used in GPT-based models.
This addresses https://github.com/microsoft/DeepSpeed/issues/828.
TODO: Add a unit test for guarding against this type of masking.
Can one of the admins verify this patch?