Text-To-Video-Finetuning icon indicating copy to clipboard operation
Text-To-Video-Finetuning copied to clipboard

Published 20 hours ago • verified publisher icon ExponentialML

Enabling Multi-GPU training

Open julkaztwittera opened this issue 1 year ago • 3 comments

How to enable multi-GPU training? No matter how many GPUs I use, only one process starts.

julkaztwittera avatar Jun 12 '23 13:06 julkaztwittera

I'm also curious about this

maximepeabody avatar Jul 20 '23 21:07 maximepeabody

Is there any progress?

Splendon avatar Jul 24 '23 01:07 Splendon

FYI, since the training code is wrapped in Accelerator, I just launch training with multiple GPUs and it seems work. Also, make sure that some functions are called only once in the main process by checking accelerator.is_main_process (e.g., create_output_folders, save_pipe, and the evaluation part)

zyshin avatar Sep 15 '23 02:09 zyshin