OLMo icon indicating copy to clipboard operation
OLMo copied to clipboard

Published 20 hours ago • verified publisher icon allenai

Full OLMo checkpoints?

Open jiahai-feng opened this issue 1 year ago • 1 comments

🚀 The feature, motivation and pitch

Hi, really appreciate the work that y'all are doing.

Are y'all planning to release the checkpoint files for OLMo 7B? Right now the HF checkpoints don't seem to contain enough information to do finetuning using this repo. For e.g., optimizer states and config files are missing.

Alternatives

No response

Additional context

No response

jiahai-feng avatar Feb 27 '24 22:02 jiahai-feng

Hi @jiahai-feng, yes we are. @2015aroras do you know the status of this?

epwalsh avatar Feb 28 '24 18:02 epwalsh

https://github.com/allenai/OLMo/pull/500

epwalsh avatar Mar 12 '24 22:03 epwalsh