litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard

error: Unrecognized arguments: --val_split_fraction 0.1

Open Magniveo opened this issue 1 year ago • 3 comments

I cloned the repository and built it, but when I ran the command to litgpt finetune lora --checkpoint_dir checkpoints/microsoft/phi-2 --data JSON --data.json_path my_custom_dataset.json --val_split_fraction 0.1 --out_dir out/phi-2-lora I encountered an error error: Unrecognized arguments: --val_split_fraction 0.1 What I doing incorrect?

Magniveo avatar Apr 15 '24 04:04 Magniveo

same problem

Moon-Ahn avatar Apr 15 '24 05:04 Moon-Ahn

It should be --data.val_split_fraction 0.1

Could you open a PR fixing it?

carmocca avatar Apr 15 '24 10:04 carmocca

ok, but i have another problem on download checkpoints/microsoft/phi-2, Permission error: [WinError 5]

Magniveo avatar Apr 15 '24 13:04 Magniveo

Arg, yes, this should be --data.val_split_fraction 0.1.

Regarding the permission error: That's a weird one. Could you try to create the folders manually before trying litgpt download --repo_id microsoft/phi-2. I believe on Windows that's mkdir checkpoints\microsoft\phi-2 .

Btw a PR to fix the --data.val_split_fraction 0.1 would be appreciated. But I am also happy to do it, just let me know.

rasbt avatar Apr 15 '24 16:04 rasbt

Problem with second tensor file. I have only one bin file.

Magniveo avatar Apr 15 '24 16:04 Magniveo

closed by #1295

williamFalcon avatar Apr 15 '24 17:04 williamFalcon