Uni-Core icon indicating copy to clipboard operation
Uni-Core copied to clipboard

Published 20 hours ago • verified publisher icon dptech-corp

How to use FP32 in uni-core?

Open bearwithdog opened this issue 2 years ago • 1 comments

I noticed the example : https://github.com/dptech-corp/Uni-Core/blob/main/examples/bert/train_bert_test.sh How could i use fp32 ? Just remove --fp16 --fp16-init-scale 4 --fp16-scale-window 256. Thanks!

bearwithdog avatar Aug 16 '22 02:08 bearwithdog

yes, remove --fp16 (or --bf16)

guolinke avatar Aug 18 '22 08:08 guolinke