llama2.c icon indicating copy to clipboard operation
llama2.c copied to clipboard

Published 20 hours ago • verified publisher icon karpathy

Is it possible to adapt this code from DDP to FSDP? If yes, what are the potential issues to look out for?

Open Calvinnncy97 opened this issue 1 year ago • 0 comments

Hi,

Thank you for the fantastic repo. I recently picked up interest in FSDP. Is it possible to adapt this model to FSDP? If yes, what are the things that I should look out for?

Thank you.

Best regards

Calvinnncy97 avatar Sep 06 '23 09:09 Calvinnncy97