Boda Sadallah issues

Repositories
Issues
Comments

Results 2 issues of


                                            Boda Sadallah

[Tacotron2/PyTorch] cuda.rang_state errore?

Related to **Model/Framework(s)** *PyTorch Distributed Training* **Describe the bug** Error: ``` torch.cuda.set_rng_state(checkpoint['cuda_rng_state_all'][device_id]) IndexError: index 2 is out of bounds for dimension 0 with size 2 ``` This error happens as...

bug

[Tacotron2/Pytorch] Multi-node error on saving checkpoints?

Related to **Model/Framework(s)** PyTorch Distributed Training **Describe the bug** The bug happens, with multinode training, cause in the training script `local_rank` is used to save checkpoints, so it repeats for...

bug