COMET icon indicating copy to clipboard operation
COMET copied to clipboard

[QUESTION] how to enable multi-gpu when calling the predict method

Open cumtsunzhenxing opened this issue 1 year ago • 1 comments

The predict method is called by setting gpus=2, but only one gpu is used. model.predict(samples=samples,batch_size=2, gpus=2, devices=2, accelerator="gpu", strategy="ddp")

cumtsunzhenxing avatar Jul 17 '24 07:07 cumtsunzhenxing

you need to specify clear device number like "devices=[1,2]": model.predict(samples=samples,batch_size=2,_ gpus=2, devices=[1,2], accelerator="gpu", strategy="ddp") or don‘t pass the 'devices' like: model.predict(samples=samples,batch_size=2,_ gpus=2, accelerator="gpu", strategy="ddp")

Sleepyhead1111 avatar Jun 23 '25 04:06 Sleepyhead1111