TXacs

Does anyone solved this problem? I got same problem when use torchrun or torch.distributed.launch, the self.local_rank is -1. my env is pytorch==2.0.0 and transorformers=4.30.1.

I have the same problem, and even I checkout v1.1.0 to run the script, got same error. My command: `torchrun --nproc-per-node=4 scripts/train.py configs/pixart/train/1x512x512.py --data-path CSV_FILE` The config is nothing changes.

Thanks a lot! I add the code into pixart.py, solved the problem! Not only stdit.py. ```python def forward(self, x, timestep, y, mask=None): """ Forward pass of PixArt. x: (N, C,...