iefgnoix

@mars1248 have been working on spmd on GPU so I assume it's GPU. https://github.com/pytorch/xla/issues/6256 gives a proposal about how to do multi-node spmd training. eg. you have 2 GPU VMs,...

> I think this is also going to overwrite the pytorch build in our nightly images, which is not what we want. Yeah, that's great point! Perhaps we make the...

hey @JackCaoG , could you approve the CI? I want to find out where I can add a test for my change. I've checked myforks/pytorch/test/cpp/lazy/test_misc.cpp but it doesn't seem to...

Hi @JackCaoG , could you take another look at the PR? I was searching for the place to add a test but couldn't find any in Pytorch. Since pytorch CI...

hey @JackCaoG , the CI is green. Thanks for the review!