PyTorch-LBFGS icon indicating copy to clipboard operation
PyTorch-LBFGS copied to clipboard

Published 20 hours ago • verified publisher icon hjmshi

8-bit L-BFGS

Open Demirrr opened this issue 3 years ago • 0 comments

Hello @hjmshi ,

Recently I stumbled upon the Bits&Bytes wrapper. Since then I can't help but wonder whether we could adapt this idea for the second order methods, namely, 8-bit L-BFGS i.e., L-BFGS using an 8-bit state instead of an 32-bit.

I was wondering whata are your initial thoughts on it ?

Demirrr avatar Jun 23 '21 06:06 Demirrr