HeroyiuWFY

Results 2 comments of HeroyiuWFY

HI, I also want to know how to train with Multi-GPUs by using python -m torch.distributed.launch --nproc_per_node 8 train.py xxx Looking forward to your Reply and thanks again for your...

@Zehaos , I tried to seperate the sigmoid and binary cross-entropy together when computing backward, which is: grad = self.factor *( mask_prob - mask_target ) / ( mask_prob (1 -...