optimum-habana icon indicating copy to clipboard operation
optimum-habana copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Initial enablement with FP8 Training (port from OHF #91)

Open libinta opened this issue 9 months ago • 0 comments

What does this PR do?

Initial enablement with FP8 Training with Intel Gaudi Transformer Engine ([(porting from OHF #91) Only linear layer is replaced with FP8.

Fixes # (issue)

Before submitting

  • [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • [ ] Did you make sure to update the documentation with your changes?
  • [ ] Did you write any new necessary tests?

libinta avatar Apr 30 '24 20:04 libinta