deepnet icon indicating copy to clipboard operation
deepnet copied to clipboard

Published 20 hours ago • verified publisher icon parasdahal

About optimization

Open GLivshits opened this issue 3 years ago • 0 comments

Hello. Are you quite sure that history of optimizer (e.g. moments) should be zeroed at the beginning of each epoch?

GLivshits avatar May 09 '21 06:05 GLivshits