torchtune
torchtune copied to clipboard
Update download commands in configs
Following the instructions in /root/torchtune/recipes/configs/llama3/8B_qlora_single_device.yaml
$ tune download meta-llama/Meta-Llama-3-8B-Instruct --output-dir /tmp/Meta-Llama-3-8B-Instruct --hf-token <HF_TOKEN>
$ tune run lora_finetune_single_device --config llama3/8B_qlora_single_device checkpointer.checkpoint_dir=/tmp/Meta-Llama-3-8B-Instruct
File "/usr/local/lib/python3.11/dist-packages/torchtune/training/checkpointing/_utils.py", line 161, in get_path
raise ValueError(f"No file with name: {filename} found in {input_dir}.")
ValueError: No file with name: consolidated.00.pth found in /tmp/Meta-Llama-3-8B-Instruct.
Original consolidated weights are no longer in the HF repo. We should check whether any other configs have this issue.