Duix.Heygem icon indicating copy to clipboard operation
Duix.Heygem copied to clipboard
verified publisher icon duixcom

多张显卡的时候如何并行推理呢?

Open benbenxj opened this issue 9 months ago • 1 comments

多张显卡的时候如何并行推理呢? 现在默认只能单卡运行 设置了os.environ["CUDA_VISIBLE_DEVICES"] = "1,2,3"的时候也只会在第一张卡上跑

benbenxj avatar Mar 24 '25 08:03 benbenxj

It is not supported at present. #300

whl88 avatar Mar 25 '25 06:03 whl88