exo icon indicating copy to clipboard operation
exo copied to clipboard

Detect RDMA status

Open Evanev7 opened this issue 2 months ago • 5 comments

We should detect whether a macOS device has RDMA enabled, reasonably through the existence of tools such as ibv_devinfo in path.

Evanev7 avatar Dec 28 '25 20:12 Evanev7

Could you please tell me how to connect four Macs? What are the rules for wiring? Are there any tutorials

VoidMore avatar Dec 29 '25 01:12 VoidMore

Could you please tell me how to connect four Macs? What are the rules for wiring? Are there any tutorials

Which macs? What interconnect?

exo makes it so you can connect your devices however you like really… if you want to use ethernet, you can connect them with ethernet. If you want to use TB5, connect them with TB5 cables. RDMA requires all-to-all TB5.

AlexCheema avatar Dec 29 '25 02:12 AlexCheema

Could you please tell me how to connect four Macs? What are the rules for wiring? Are there any tutorials请问如何连接四台 Mac 电脑?接线有什么规则?有相关的教程吗?

Which macs? What interconnect?哪些型号的 Mac?使用什么连接线?

exo makes it so you can connect your devices however you like really… if you want to use ethernet, you can connect them with ethernet. If you want to use TB5, connect them with TB5 cables.exo 让你可以随心所欲地连接设备……如果你想用以太网,就可以用以太网线连接;如果你想用雷电 5,就可以用雷电 5 线缆连接。 RDMA requires all-to-all TB5.RDMA 需要全对全的 TB5。

Mac mini M3 Ultra.

Is it necessary to enter the recovery mode to enable RDMA when starting it

VoidMore avatar Dec 29 '25 07:12 VoidMore

Could you please tell me how to connect four Macs? What are the rules for wiring? Are there any tutorials请问如何连接四台 Mac 电脑?接线有什么规则?有相关的教程吗?

Which macs? What interconnect?哪些型号的 Mac?使用什么连接线? exo makes it so you can connect your devices however you like really… if you want to use ethernet, you can connect them with ethernet. If you want to use TB5, connect them with TB5 cables.exo 让你可以随心所欲地连接设备……如果你想用以太网,就可以用以太网线连接;如果你想用雷电 5,就可以用雷电 5 线缆连接。 RDMA requires all-to-all TB5.RDMA 需要全对全的 TB5。

Mac mini M3 Ultra.

Is it necessary to enter the recovery mode to enable RDMA when starting it

it is necessary, yes. This is what macOS requires.

AlexCheema avatar Dec 30 '25 01:12 AlexCheema

Could you please tell me how to connect four Macs? What are the rules for wiring? Are there any tutorials请问如何连接四台 Mac 电脑?接线有什么规则?有相关的教程吗?

Which macs? What interconnect?哪些型号的 Mac?使用什么连接线? exo makes it so you can connect your devices however you like really… if you want to use ethernet, you can connect them with ethernet. If you want to use TB5, connect them with TB5 cables.exo 让你可以随心所欲地连接设备……如果你想用以太网,就可以用以太网线连接;如果你想用雷电 5,就可以用雷电 5 线缆连接。 RDMA requires all-to-all TB5.RDMA 需要全对全的 TB5。

Mac mini M3 Ultra.Mac mini M3 Ultra。 Is it necessary to enter the recovery mode to enable RDMA when starting it启动时是否必须进入恢复模式以启用 RDMA

it is necessary, yes. This is what macOS requires.这是必要的,没错。这正是 macOS 的要求。

However, even after I enabled rdma_ctl, the four Mac Studio M3 Ultra instances did not discover each other, and MLX RDMA still could not be used.

VoidMore avatar Dec 30 '25 11:12 VoidMore