k8s-rdma-sriov-dev-plugin icon indicating copy to clipboard operation
k8s-rdma-sriov-dev-plugin copied to clipboard

Published 20 hours ago • verified publisher icon Mellanox

got all VF with port state 'DOWN'

Open yh-xu opened this issue 5 years ago • 2 comments

I deployed rdma-sriov-dev-plugin in SRIOV mode for IB. The VFs were created but when running ibstat, I got the result that only mlx5_0 had port state "Active", while all others ( mlx5_1~mlx5_10 for 10 VFs) had port state "DOWN" (as image below). and I have checked policy for all VFs is "Follow". image

I'm using ubuntu16.04 , kubernetes v 1.15. What should I do to make all VF ports active? Would it be something wrong in SM? I have SM running on IB switch with virtualization turned on.

yh-xu avatar Feb 19 '20 15:02 yh-xu

@yh-xu My suspect is SM config given that physical link is up

paravmellanox avatar Feb 19 '20 22:02 paravmellanox

@yh-xu My suspect is SM config given that physical link is up

Does device-plugin work with hardware SM? I was referring this document (https://community.mellanox.com/s/article/kubernetes-ipoib-ethernet-rdma-sr-iov-networking-with-connectx4-connectx5?tdsourcetag=s_pctim_aiomsg ) which mentioned "opensm virtualization config", but didn't tell how to deal with hardware subnet manager.

yh-xu avatar Feb 20 '20 01:02 yh-xu