LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

请问Qwen1.5-32B-Chat-GPTQ-Int4这个可以微调吗?

Open acbp1379 opened this issue 10 months ago • 2 comments

Reminder

  • [X] I have read the README and searched the existing issues.

Reproduction

ModuleNotFoundError: No module named 'optimum' 但是我的python环境里面是有这个包的。 deepspeed --num_gpus 3 src/train_bash.py
--deepspeed examples/deepspeed/ds_z2_config.json
--stage sft
--do_train
--model_name_or_path /home/models/Qwen/Qwen1.5-32B-Chat-GPTQ-Int4/
--dataset alpaca_gpt4_en
--dataset_dir data
--template default
--finetuning_type lora
--lora_target q_proj,v_proj
--output_dir saves/qwen1.5-32B/sft/
--overwrite_cache
--overwrite_output_dir
--cutoff_len 1024
--per_device_train_batch_size 1
--per_device_eval_batch_size 1
--gradient_accumulation_steps 8
--lr_scheduler_type cosine
--logging_steps 10
--save_steps 100
--eval_steps 100
--evaluation_strategy steps
--load_best_model_at_end
--learning_rate 5e-5
--num_train_epochs 3.0
--max_samples 3000
--val_size 0.1
--plot_loss
--fp16

Expected behavior

No response

System Info

No response

Others

No response

acbp1379 avatar Apr 09 '24 01:04 acbp1379