alpaca-qlora
alpaca-qlora copied to clipboard
ValueError: test_size=2000 should be either positive and smaller than the number of samples 2 or a float in the (0, 1) range
Traceback (most recent call last):
File "/home/studio-lab-user/sagemaker-studiolab-notebooks/alpaca-qlora/finetune.py", line 419, in
Maybe something to do with dataset .. using standard alpaca format
using >>
python finetune.py
--base_model 'openlm-research/open_llama_3b_600bt_preview'
--data_path '../datasets/dolly.json'
--num_epochs=3
--cutoff_len=512
--group_by_length
--output_dir='./dolly-lora-3b'
--lora_r=16
--lora_target_modules='[q_proj,v_proj]'
Where is the ../datasets/dolly.json file .. I would like to see this data how it look.. Any advise/ Thanks