open-instruct icon indicating copy to clipboard operation
open-instruct copied to clipboard
verified publisher icon allenai

Adding support for latest OLMo architectures

Open natolambert opened this issue 1 year ago • 1 comments

natolambert avatar Sep 05 '24 20:09 natolambert

Yup @vwxyzjn have trained a couple models. Most recent one https://wandb.ai/ai2-llm/open_instruct_internal/runs/ny1m6zwx?nw=nwusernatolambert (plus another that already had eval scores, see slack)

natolambert avatar Sep 17 '24 19:09 natolambert

Let's close it since we are training olmo2 with transformer's implementation.

vwxyzjn avatar Dec 03 '24 18:12 vwxyzjn