Alpaca-CoT icon indicating copy to clipboard operation
Alpaca-CoT copied to clipboard

error on Multiple GPUs:

Open weberrr opened this issue 1 year ago • 1 comments

I can run on a single gpu, but multi-gpu will report the following error, has anyone encountered it " uniform_finetune.py: error: unrecognized arguments: --local-rank=3 ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 2) local_rank: 0 (pid: 141382) of binary: /usr/local/conda/bin/python3 "

image

weberrr avatar Apr 01 '23 07:04 weberrr