YaLM-100B icon indicating copy to clipboard operation
YaLM-100B copied to clipboard

No mention of `bfloat16` in source, and yet weights are `bfloat16`

Open lostmsu opened this issue 2 years ago • 0 comments

generate_*.sh scripts appear to create fp16 model and load weights into it, but the weights are bfloat16.

lostmsu avatar Aug 09 '22 00:08 lostmsu