torchtune icon indicating copy to clipboard operation
torchtune copied to clipboard

Update download commands in configs

Open SalmanMohammadi opened this issue 5 months ago • 0 comments

Following the instructions in /root/torchtune/recipes/configs/llama3/8B_qlora_single_device.yaml

$ tune download meta-llama/Meta-Llama-3-8B-Instruct --output-dir /tmp/Meta-Llama-3-8B-Instruct --hf-token <HF_TOKEN>
$ tune run lora_finetune_single_device --config llama3/8B_qlora_single_device checkpointer.checkpoint_dir=/tmp/Meta-Llama-3-8B-Instruct

  File "/usr/local/lib/python3.11/dist-packages/torchtune/training/checkpointing/_utils.py", line 161, in get_path
    raise ValueError(f"No file with name: {filename} found in {input_dir}.")
ValueError: No file with name: consolidated.00.pth found in /tmp/Meta-Llama-3-8B-Instruct.

Original consolidated weights are no longer in the HF repo. We should check whether any other configs have this issue.

SalmanMohammadi avatar Sep 22 '24 22:09 SalmanMohammadi