XueFengHF

同样的问题，4卡3090,example只能单卡，finetune单卡爆显存，多卡报错ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: -9) local_rank: 2 (pid: 15250) of binary: /opt/conda/envs/internlm/bin/python