torchtune icon indicating copy to clipboard operation
torchtune copied to clipboard

llama 3 consolidated.00.pth doesnt exist

Open bdytx5 opened this issue 1 year ago • 2 comments

how do i create this from the safetensors dowloaded from the tune download command?

bdytx5 avatar Apr 18 '24 22:04 bdytx5

Hey @bdytx5, if you've followed the tutorial and downloaded with a similar tune command to tune download meta-llama/Meta-Llama-3-8B --output-dir <checkpoint_dir> --hf-token <ACCESS TOKEN>, then you should see the consolidated.00.pth file in the original folder in your checkpoint dir:

(torchtune) [rafiayub@rafiayub-mbp /Users/rafiayub/torchtune (main)]$ ls /tmp/Llama-3-8B-hf/original
consolidated.00.pth  params.json  tokenizer.model

RdoubleA avatar Apr 18 '24 22:04 RdoubleA

ah ok now I see it. Thanks!

bdytx5 avatar Apr 18 '24 23:04 bdytx5