paxml icon indicating copy to clipboard operation
paxml copied to clipboard

Add Transformer Engine support to Paxml

Open ashors1 opened this issue 9 months ago • 0 comments

Adds support for NVIDIA's Transformer Engine. TE can be enabled by setting the environment variable ENABLE_TE=1. For more details about running Pax with Transformer Engine, refer to the JAX Toolbox README.

ashors1 avatar Sep 12 '23 19:09 ashors1