torchtune
torchtune copied to clipboard
llama 3 consolidated.00.pth doesnt exist
how do i create this from the safetensors dowloaded from the tune download command?
Hey @bdytx5, if you've followed the tutorial and downloaded with a similar tune command to tune download meta-llama/Meta-Llama-3-8B --output-dir <checkpoint_dir> --hf-token <ACCESS TOKEN>, then you should see the consolidated.00.pth file in the original folder in your checkpoint dir:
(torchtune) [rafiayub@rafiayub-mbp /Users/rafiayub/torchtune (main)]$ ls /tmp/Llama-3-8B-hf/original
consolidated.00.pth params.json tokenizer.model
ah ok now I see it. Thanks!