Sea-Snell

icon indicating a website link https://sea-snell.github.io icon indicating an email [email protected]

icon location Berkeley, CA icon location CS at UC Berkeley. NLP / RL

Results 1 issues of Sea-Snell

Adafactor + MultiStep with bfloat16 model doesn't work

5 comment

If I use Adafactor with MultiStep on a bfloat16 model I get this strange error (note the error is extremely long, so I truncated it to fit in the issue;...