Will you support multi-GPU tensor parallelism in the future?

Open Willian7004 opened this issue 1 year ago • 4 comments

I run this model on cloud server so I can choose to rent multi-GPU,it takes more than 1 hour to generate a video in 1 GPU and it doesn't get faster when I use more GPU.So I hope that you can support multi-GPU tensor parallelism in the future.

Sep 12 '24 02:09 Willian7004

We've fixed bugs, please update.

Sep 12 '24 06:09 hejingwenhejingwen

I have the same thing. Out of 15 minutes for 1xGPU I have 25 minutes for 2xGPU. Additionally, the video is of lower quality and is looped twice. Used fresh main branch

Sep 12 '24 15:09 snapshotpl

I miss that scale changed, but still same time on 2x GPU and looped video twice.

Sep 12 '24 16:09 snapshotpl

I have the same thing. Out of 15 minutes for 1xGPU I have 25 minutes for 2xGPU. Additionally, the video is of lower quality and is looped twice. Used fresh main branch

We have fixed it, please update!

Sep 16 '24 12:09 hejingwenhejingwen