run tortoise-tts on several gpus at once

[MagicChakram]

For users with 2+ dedicated gpus in a system (nvidia sli) - is there a way to speed up the process by loading both gpus?

[kevinamiri]

Does attaching --use_deepspeed helps?

or

api.TextToSpeech(use_deepspeed=True)

[MagicChakram]

Does attaching --use_deepspeed helps?

or

api.TextToSpeech(use_deepspeed=True)

according to docs it is more about speedup of process (which itself on windonws didn't work for me for varios reasons - can't compile lib etc) that is stull executed on a single device. What I'm looking for is to utilise more than one gpu at once in system. Or have it selected. For example defult param would be use_gpu = 0 (uses all available cards in system) or use_gpu = 1 (uses first card of N cards in system)

[xiaoyangnihao]

how you solve this? I want to train ar module with multi-gpus too.

[MagicChakram]

how you solve this? I want to train ar module with multi-gpus too.

unfortunately I have no solution to run this on specified gpus under windows or force it to use both installed dedicated cards in the system..

[FranS-C]

Is there any updates on this? It would be lovely to be able to just specify the GPU to run on, so for example you can run other GPU heavy tasks and leave tortoise alone in the second GPU. In My case running Unreal engine in GPU 1 and Tortoise in the GPU 2