how sglang utilizes the InfiniBand? Are there any relevant documents or guides? Thanks

[BoBo0037]

[jhinpan]

Here is the documentation that you can refer: https://docs.sglang.ai/references/multi_node_inference_k8s_lws.html

[zhyncs]

ref https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3#example-serving-with-two-h208-nodes https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3#example-serving-with-two-h2008-nodes-and-docker

Please try to use the latest image docker pull lmsysorg/sglang:latest and set export NCCL_IB_GID_INDEX=3.

[BoBo0037]

ref https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3#example-serving-with-two-h208-nodes https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3#example-serving-with-two-h2008-nodes-and-docker

Please try to use the latest image docker pull lmsysorg/sglang:latest and set export NCCL_IB_GID_INDEX=3.

thank you！