Release the intermediate checkpoints?

[NathanGodey]

Hello! Thank you for the great work. I was wondering if you planned to release the intermediate checkpoints for all pretrained models as in Pythia (https://arxiv.org/pdf/2304.01373.pdf)?

[kernelmachine]

We are working on releasing intermediate checkpoints and will let you know

[NathanGodey]

Do you have any updates about this issue? :)