math-lm icon indicating copy to clipboard operation
math-lm copied to clipboard

Published 20 hours ago • verified publisher icon EleutherAI

Optimizer states?

Open jenkspt opened this issue 1 year ago • 1 comments

Hi I'm interested in getting access to the optimizer states for the final llemma checkpoints. Are these available? - and if not, can they be made public?

Thanks for your amazing work!

jenkspt avatar Dec 26 '23 18:12 jenkspt

Also interested in older checkpoints of 7b model -- specifically interested in estimating the performance of the 34b model with more tokens.

jenkspt avatar Dec 27 '23 15:12 jenkspt