PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard
verified publisher icon pytorch

Non-0 rank creates CUDA context on GPU 0

Open kwen2501 opened this issue 1 year ago • 1 comments

Screenshot 2024-03-06 at 11 54 48 AM Need to investigate if this is a test issue or pippy issue or general pytorch issue.

kwen2501 avatar Mar 06 '24 19:03 kwen2501

Looks like a general pytorch issue: Running a simple DDP program:

Screenshot 2024-03-06 at 12 09 42 PM

kwen2501 avatar Mar 06 '24 20:03 kwen2501