DeepSpeed-MII icon indicating copy to clipboard operation
DeepSpeed-MII copied to clipboard
verified publisher icon microsoft

deepseed-mii支持多节点推理么

Open JKYtydt opened this issue 1 year ago • 2 comments 

### Tasks

JKYtydt avatar Jul 04 '24 09:07 JKYtydt

若我有两台机器，每个机器分别有2个GPU，如何实现多节点推理

JKYtydt avatar Jul 04 '24 09:07 JKYtydt

Hi @JKYtydt - the tutorial on inference for DeepSpeed here includes directions on how to invoke DeepSpeed such that it can support multi-node inference.

loadams avatar Jul 18 '24 23:07 loadams