Model ladder has no documentation
📚 The doc issue
It would be great if there was some kind of a readme for the model ladder (https://github.com/allenai/OLMo/pull/649). As far as I know there is currently no documentation for this.
I believe this is the entry point? https://github.com/allenai/OLMo/blob/main/scripts/ladder.py
@taidnguyen, @dwadden, and I will likely want to run data mix experiments in the future that make use of the model ladder for standardization and having some basic documentation would avoid having each of us have to come bug people for 1:1 explanations.
Suggest a potential alternative/fix
No response
Intending to address this with https://github.com/allenai/OLMo/pull/708
Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open and we will get back to you!