OLMo icon indicating copy to clipboard operation
OLMo copied to clipboard
verified publisher icon allenai

We should be storing a checkpoint of the untrained model

Open dirkgr opened this issue 2 years ago • 0 comments

https://github.com/allenai/LLM/blob/2118db56095157474fe1c69c1702db08af2d4f74/scripts/train.py#L187

I think having a checkpoint before any training happens would be quite useful.

dirkgr avatar Jul 19 '23 20:07 dirkgr