Zhengyang Feng

> I will update it for multi-gpus after I reproduce it. Maybe next week, now the time is not enough. That's great to hear! Go for it!

@lorenmt Good point! Thanks a lot! @jinhuan-hit If you're still working on this, `Accelerate` seems a good place to start. And it's perfectly ok if you don't want to send...

@jinhuan-hit Thanks a lot! I still don't have the hardware to debug multi-GPU for now. But hopefully I'll be able to debug this month/the next. The problem seems related to...

> I have already check the network, but find nothing. Yes I think you're right. I also did not find redundant layers. I'll also try investigate this when I got...

@jinhuan-hit If the results are similar compared to single card under mixed precision, maybe you'd like to send a pull request for this?

Thanks a lot! If a PyTorch version update that concerns code change is necessary for using Accelerate, please make the version update & multi-GPU in 2 separate PRs, if possible...

> I have checked the result and it looks normal! Great! I'll formulate a draft PR for comments.

Thanks for everyone's help! DDP is now supported. Please report bugs if you've found any.

Any update on this? Are the eigen values from COCO dataset? @princeton-vl @heilaw

> Can you refer to the issues in that repo? It's hard for me to give you the answer as many old codes have been cleaned several days ago. I...