brpc icon indicating copy to clipboard operation
brpc copied to clipboard
verified publisher icon apache

使用master版本，rdma只能到7GB带宽，attach_ment=512K，无法进一步提高带宽，如何优化

Open jinxing1985 opened this issue 1 month ago • 5 comments

Describe the bug

To Reproduce

Expected behavior

Versions OS: Compiler: brpc: protobuf:

Additional context/screenshots

jinxing1985 avatar Nov 19 '25 11:11 jinxing1985

jinxing1985 avatar Nov 19 '25 12:11 jinxing1985

I1119 20:46:11.691596 3058081 0 /home/jinxing/brpc/src/brpc/rdma/rdma_helper.cpp:353 ReadRdmaDynamicLib] Successfully loaded libibverbs.so I1119 20:46:11.799122 3058081 0 /home/jinxing/brpc/src/brpc/rdma/rdma_helper.cpp:495 GlobalRdmaInitializeOrDieImpl] RDMA device: mlx5_0 I1119 20:46:11.

jinxing1985 avatar Nov 19 '25 12:11 jinxing1985

服务端：./server --rdma_device mlx5_0 --rdma_sq_size=2048

jinxing1985 avatar Nov 19 '25 12:11 jinxing1985

./client --rdma_device mlx5_0 -servers 10.0.106.17:8005 。网卡为IB网卡，400Gbps

jinxing1985 avatar Nov 19 '25 12:11 jinxing1985

目前提升带宽的方式有两种：

  • 第一种，建链模式为连接池模式，通过提升client端的线程并发来提升带宽。
  • 第二种，建链模式为单连接模式，通过提升client端的进程数据来提升带宽。

这两种方式可以试试 @jinxing1985

zchuango avatar Dec 10 '25 08:12 zchuango