TinyLlama icon indicating copy to clipboard operation
TinyLlama copied to clipboard

Saturation / epoch-accuracy plot

Open rasbt opened this issue 1 year ago • 0 comments

Thanks for sharing this awesome work (and the paper write-up)! I was wondering if you by chance have a plot similar to the one from the Pythia paper but for all 3 epochs. If so, that would be super interesting and intriguing.

Pythia_saturation

rasbt avatar Jan 09 '24 15:01 rasbt