llama-cookbook icon indicating copy to clipboard operation
llama-cookbook copied to clipboard

Published 20 hours ago • verified publisher icon meta-llama

Inference with "FULL_STATE_DICT" checkpoint from FSDP fine tuning

Open mathmax12 opened this issue 1 year ago • 2 comments

🚀 The feature, motivation and pitch

I can get a single checkpoint after using FSDP fine tune the model. image My question is how can I use this single checkpoint for inference? Thanks

Alternatives

No response

Additional context

No response

mathmax12 avatar Oct 02 '24 00:10 mathmax12