ChatGLM-Tuning
ChatGLM-Tuning copied to clipboard
mymusise
双卡，每卡12g显存，一共24g显存，为啥会爆显存溢出
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 128.00 MiB (GPU 0; 14.61 GiB total capacity; 13.73 GiB already allocated; 83.12 MiB free; 13.79 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
cd ptuning
python main.py --do_train --train_file ../answers.json
--validation_file ../dev.json
--prompt_column prompt
--response_column response
--overwrite_cache
--model_name_or_path ../model/chatglm-6b
--output_dir ../output
--overwrite_output_dir
--max_source_length 256
--max_target_length 256
--per_device_train_batch_size 1
--per_device_eval_batch_size 1
--gradient_accumulation_steps 16
--predict_with_generate
--max_steps 500
--logging_steps 10
--save_steps 50
--learning_rate 2e-2
--pre_seq_len 128
