Open-Sora icon indicating copy to clipboard operation
Open-Sora copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

2080ti咋玩，模型T5 加载一半显存就炸了

Open xujin1184104394 opened this issue 11 months ago • 1 comments

为何开了sequence parallelism 但是每张卡还需要单独加载整个T5语言模型？ 开了8卡也同样炸显存。。。。

xujin1184104394 avatar Mar 20 '24 09:03 xujin1184104394