llm-foundry Upgrade to `mosaicml-streaming==0.5.x`

Upgrade to `mosaicml-streaming==0.5.x`

Open abhi-mosaic opened this issue 2 years ago • 2 comments

Jun 06 '23 18:06 abhi-mosaic

Yup will run some convergence tests before merging

Jun 06 '23 18:06 abhi-mosaic

Would recommend waiting on this merge until we get a hotfix release 0.5.1

Jun 07 '23 14:06 abhi-mosaic

With baseline usage, main and this branch have similar performance Screenshot 2023-06-20 at 4 06 34 PM MFU is also effectively exactly the same

the only diff is that the update uses slightly less sys mem Screenshot 2023-06-20 at 4 08 28 PM

https://wandb.ai/mosaic-ml/streaming051_updt

Jun 20 '23 23:06 vchiley