Alpaca-CoT
Alpaca-CoT copied to clipboard
error on Multiple GPUs:
I can run on a single gpu, but multi-gpu will report the following error, has anyone encountered it " uniform_finetune.py: error: unrecognized arguments: --local-rank=3 ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 2) local_rank: 0 (pid: 141382) of binary: /usr/local/conda/bin/python3 "
![image](https://user-images.githubusercontent.com/22020454/229273617-28c6aa72-d29a-4f3c-b807-be9837c2c5ca.png)