DeepPavlov icon indicating copy to clipboard operation
DeepPavlov copied to clipboard

Published 20 hours ago • verified publisher icon deeppavlov

8bit optimizers

Open dimakarp1996 opened this issue 2 years ago • 0 comments

Added 8bit optimizers. These optimizers, as my experiments have shown, yield ~9-11% memory economy on training. The code is absolutely backward-compatible.

dimakarp1996 avatar Jan 31 '23 20:01 dimakarp1996