Does not working on cuda:1

[Mombin]

Hello. Thank you for providing a greate code.

I have a issue on running prediction.

if i predice on cuda:1, the inference is not working.....

i trace the code step by step and I found "op/fused_act.py" load fused_bias_Act.cpp and fused_bias_act_kernel.cu. that cpp code cannot another gpu...

how can i predict with other gpu?.....

[hunghn-dmobin]

Same issue, @Mombin have you found a solution yet?

[Mombin]

@hunghn-dmobin Insert the following keywords into the introduction of your code.

torch.cuda.set_device(device)

then it is working fine.

[dummyuser-123]

Hi @Mombin ,

Exactly where we have to insert this line: torch.cuda.set_device(device), in the model.py ?

I have tried like this, but this it is not working for me.