server icon indicating copy to clipboard operation
server copied to clipboard

W0821 08:49:41.251296 104802 server.cc:208] failed to enable peer access for some device pairs

Open frankxyy opened this issue 2 years ago • 1 comments

I have 8 gpus on my machine. When starting the server, this warning message is printed. How does this mean?

frankxyy avatar Aug 21 '22 08:08 frankxyy

Hi @frankxyy ,

Please share the full error log for more info/context if you need more information.

Assuming this warning is coming from TensorFlow, see this post: https://stackoverflow.com/a/43946365

It should not cause any errors, this warning just means communication between GPUs may be slower than on a system with P2P capabilities. You can also see the output of nvidia-smi topo -m for more information on the GPU topology for your system.

CC @Tabrizian @nv-kmcgill53

rmccorm4 avatar Aug 22 '22 22:08 rmccorm4

Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this issue.

krishung5 avatar Oct 13 '22 00:10 krishung5