Ali Hatamizadeh

icon indicating an email [email protected]

icon company NVIDIA icon location Building something for the community

Results 1 issues of Ali Hatamizadeh

DataLoader state is empty for different ranks ?

1 comment

Thanks for your amazing work ! We have been testing the llama3_8b model on slimpajama dataset. The training seem to be fine based on loss curves. However, upon resuming the...

question