Sarath Kondeti

I trying to figure out why my script doesn't work without "--force_multi" param in ds_launch_str https://github.com/microsoft/DeepSpeed-MII/blob/0fe4eb86b93e8210736f3e8c671bc886af64fd67/mii/server.py#L116 Expected parallelism: replicas 4 and TP 1 Hardware: 2 machines with 2xTesla T4s each...