optimum-habana icon indicating copy to clipboard operation
optimum-habana copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Is there example of FP8 train LLM, pre-train or fine-tune

Open harborn opened this issue 8 months ago • 1 comments

Feature request

I see the release version 1.12 has supported fp8, but I didn't see any example code for how to train LLM by using FP8. How can I use FP8 to train model?

Motivation

I want to train model by using FP8.

Your contribution

NO.

harborn avatar Jun 14 '24 05:06 harborn