MaskDINO icon indicating copy to clipboard operation
MaskDINO copied to clipboard

MaskDINO support for CPU-only inference

Open neelabhtiwari opened this issue 2 years ago • 1 comments

Hi,

  1. The MaskDINO uses the DETR (https://github.com/fundamentalvision/Deformable-DETR) module which wasn't available in CPU-Only format until recently. But there's a new open source implementation at Huggingface now which supports CPU (https://github.com/fundamentalvision/Deformable-DETR/issues/160). Are the authors of this paper or anyone else planning to build the MaskDINO CPU-Only inference support?

  2. Also the install docs of MaskDINO mention that in absence of GPU, this command can be used for setup -

To build on a system that does not have a GPU device but provide the drivers: TORCH_CUDA_ARCH_LIST='8.0' FORCE_CUDA=1 python setup.py build install

https://github.com/IDEA-Research/MaskDINO/blob/main/INSTALL.md#:~:text=TORCH_CUDA_ARCH_LIST%3D%278.0%27%20FORCE_CUDA%3D1%20python%20setup.py%20build%20install I am a bit confused about this part, because without GPU, how would one be able to set up drivers (CUDA) on any system?

  1. I was able to train the model on a GPU machine but I don't have access to a GPU now and I wanted to run inference on a CPU machine, if anyone can help with that or confirm CPU-only inference is not possible for MaskDINO as of now, it would be very helpful. Thanks!

neelabhtiwari avatar Jan 31 '23 11:01 neelabhtiwari

Hey, we did not try CPU inference before, so we can not provide any suggestions now.

FengLi-ust avatar Feb 05 '23 10:02 FengLi-ust