Bruce Lv

使用lora微调baichuan2-7b-base，3*V100（16G），还是OOM？到底需要多少内存

7

如题，使用的默认数据 deepspeed --include=localhost:4,5,7 fine-tune.py \ --report_to "none" \ --data_path "data/belle_chat_ramdon_10k.json" \ --model_name_or_path "/home/admin/baichuan2/baichuan-inc/Baichuan2-7B-Base" \ --output_dir "output" \ --model_max_length 64 \ --num_train_epochs 1 \ --per_device_train_batch_size 1 \ --gradient_accumulation_steps 1 \ --save_strategy...

在dsw安装魔塔报错

3

pip install modelscope==1.4.2 -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html ERROR: Could not find a version that satisfies the requirement datasets=2.7.0 (from modelscope) (from versions: 0.0.9, 1.0.0, 1.0.1, 1.0.2, 1.1.0, 1.1.1, 1.1.2, 1.1.3, 1.2.0, 1.2.1,...

OMP: Error #15: Initializing libiomp5.dylib, but found libomp.dylib already initialized. OMP: Hint This means that multiple copies of the OpenMP runtime have been linked into the program. That is dangerous,...

多进程的原因吗？减少进程数可解决吗