bert icon indicating copy to clipboard operation
bert copied to clipboard

Published 20 hours ago • verified publisher icon google-research

how to train BERT in bfloat16 mode on TPUs?

Open fangli80 opened this issue 3 years ago • 0 comments

Hello, Has anyone tried to train a BERT model using bfloat16? Thanks, Li

fangli80 avatar Oct 09 '21 03:10 fangli80