DDP error for advloss and gp

[wcyjerry]

Thx for ur great work! I'm using ur losses to my task and when I train it in ddp, it has some errors, hopefully u can check it. when I backward adv_loss for D I have solved this by replacing BN to sync BN and then I meet another error in gp and still remain to be solved. could u please share some methods? thx