ViT-pytorch
ViT-pytorch copied to clipboard
For torch.distributed.launch ARG --local_rank should be --local-rank
When using -m torch.distributed.launch --nproc_per_node=2 as an example it uses --local-rank and not the expected --local_rank which generate a fatal error.
https://github.com/jeonsworld/ViT-pytorch/blob/460a162767de1722a014ed2261463dbbc01196b6/train.py#L281
Setting the arg to local-rank in train.py resolved the issue and it then works as expected