starcoder icon indicating copy to clipboard operation
starcoder copied to clipboard

Update finetune launch command and remove local_rank

Open nopperl opened this issue 2 years ago • 0 comments
trafficstars

The readme instructs to use the old torch.distributed.launch command instead of torch.distributed.run, which is incompatible with finetune/finetune.py because it sets the local rank using --local-rank instead of --local_rank, leading to the following error:

finetune.py: error: unrecognized arguments: --local-rank=0

This PR updates the readme to use torch.distributed.run.

Also, it seems like the --local_rank argument is not necessary because it's not used in finetune/finetune.py at all, so I removed it.

nopperl avatar Jun 20 '23 13:06 nopperl