Ziyu Chen

icon company Tongji University icon location Shanghai icon location Vision-Language Model, Self-supervised Learning, Video Captioning

Results 1 comments of Ziyu Chen

DDP degrades the performance

The problem may come with DDP settings. The PyTorch DDP [notes about **Backward Pass**](https://pytorch.org/docs/master/notes/ddp.html) “so after the backward pass, the grad field on the same corresponding parameter across different DDP...