once-for-all icon indicating copy to clipboard operation
once-for-all copied to clipboard

Published 20 hours ago • verified publisher icon mit-han-lab

All memory on one card

Open Hukongtao opened this issue 2 years ago • 0 comments

When I train with two cards on my machine with horovodrun -np 2 -H localhost:2 python train_ofa_net.py, The code works fine. But I found that the memory of both processes is on the same card. Do you know why?

image

Hukongtao avatar Jan 18 '22 05:01 Hukongtao