Taos

Yes, I created a new conda env CrossPoint to conduct: pip install torch==1.11.0+cu102 torchvision==0.12.0+cu102 --extra-index-url https://download.pytorch.org/whl/cu102 pip install -r requirements.txt Here is the package installed on CrossPoint: cudatoolkit 10.2.89 python...

Update: The problem is solved with adding the setting before DDP initialization (dist.init_process_group()): ``` os.environ.setdefault("CUDA_VISIBLE_DEVICES", "0, 1, 2, 3") torch.cuda.set_device(rank) ``` Here is how I solved the problem: I met...

Sorry for bothering, just found that I forgot to set the range in inference. After setting the range to '51.2,51.2', the result is correct now.

ubuntu 22.04 +1

Thank you for reply. I've found the answers from the review forum. Again, it is a very solid work, and thank you for your contribution.