litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard
verified publisher icon Lightning-AI

TransformerEngine integration

Open carmocca opened this issue 2 years ago • 0 comments

  • Implements padding support directly in the model.
  • Adds a version of the model fully integrated with TransformerEngine
  • Adds a guide for training with TransoformerEngine (WIP)

carmocca avatar Jun 08 '23 05:06 carmocca