ViT-Adapter icon indicating copy to clipboard operation
ViT-Adapter copied to clipboard
verified publisher icon czczup

Inference in batches and multiple GPU

Open OmergottliebAB opened this issue 1 year ago • 1 comments

  1. I am trying to use infer model on multiple GPU but I get an error of unathurised access to GPU.Do I need to config the repo accordingly / how to use cuda visible devices ?
  2. Can I infer with images batches?

OmergottliebAB avatar Feb 12 '24 11:02 OmergottliebAB

I did inference on multiple GPUs on vast.ai and I didn't have problems. The only things I did was to give privileges to dist_test.sh. You can try either chmod +x dist_test.sh or chmod 777 dist_test.sh

edoproch avatar Feb 20 '24 11:02 edoproch