PiPPy
PiPPy copied to clipboard
dtensor_tests generate tests with numel == 0 , causing redistribute (all_gather) to abort
This depends on issue https://github.com/pytorch/pytorch/issues/85234 It's hard to debug since the abort doesn't generate stack trace or any exceptions that can be caught.