Ziyan Chen

icon indicating an email [email protected]

icon company University of Chinese Academy of Science icon location Shenzhen icon location M.Eng. student @XPixelGroup at UCAS

Results 4 comments of Ziyan Chen

About training steps and correctness.

Same here. Anyone got solutions?

Running multi-gpu training

The codes use `accelerate` to do DDP automatically.

Running multi-gpu hangs after first step

Caught the same problem here. Multi-GPU training would stuck in step 1 while single-GPU training works fine. I did some debugging. The first step always works fine until the second...

Running multi-gpu hangs after first step

I've done some debugging. I believed that some reasons caused this hanging, such as my linux kernel is too old that it can't support latest version of torch and accelerate,...