equinox icon indicating copy to clipboard operation
equinox copied to clipboard

Half or mixed precision?

Open jloganolson opened this issue 1 year ago • 1 comments

Hello! Are there an examples of doing half or mixed precision? If I'm just using nn.Linear layers, I'm guessing the most straightforward thing to do would be to make a copy where the weights/biases have dtype='float16' tacked on the end (or equivalent using jmp)?

jloganolson avatar Nov 03 '22 19:11 jloganolson