parallelformers icon indicating copy to clipboard operation
parallelformers copied to clipboard

Published 20 hours ago • verified publisher icon tunib-ai

Cross-node inference

Open BDHU opened this issue 2 years ago • 3 comments

Is there any way to perform tensor parallelism across multiple nodes instead just in a single node? Any tips would be helpful!

BDHU avatar Dec 09 '22 22:12 BDHU

same asking here

sharlec avatar Apr 26 '23 23:04 sharlec

same asking here :)

YixinSong-e avatar May 06 '23 10:05 YixinSong-e

same asking here

vinnitu avatar Aug 31 '23 12:08 vinnitu