packnet-sfm icon indicating copy to clipboard operation
packnet-sfm copied to clipboard

MinkowskiEngine cuda error

Open mengjiaos opened this issue 3 years ago • 4 comments

Hello! When I was training DDAD datasets, the following problems occurred after running for a period of time: RuntimeError: CUDA error encountered at: /workspace/MinkowskiEngine/src/3rdparty/concurrent_unordered_map.cuh:595: 209 cudaErrorNoKernelImageForDevice no kernel image is available for execution on the device. I have no idea to solve this problem.

mengjiaos avatar Sep 23 '21 07:09 mengjiaos

There are different versions of the Minkowski Engine, are you using our dockerfile?

VitorGuizilini-TRI avatar Oct 05 '21 16:10 VitorGuizilini-TRI

Hello! Thank you for such great work! @VitorGuizilini , I am also getting same error as @mengjiaos:

File "/workspace/packnet-sfm/packnet_sfm/networks/layers/resnet/resnet_encoder.py", line 88, in forward x = (input_image - 0.45) / 0.225 RuntimeError: CUDA error: no kernel image is available for execution on the device

Using 1 RTX 3090 GPU with NVIDIA CUDA version 11.2 installed on my workstation. Could this be causing this error?

EphChem avatar Oct 05 '21 18:10 EphChem

same problem. using your dockerfile

shaiSchneider avatar Nov 16 '21 16:11 shaiSchneider

Hi, I've already created a new issue: https://github.com/TRI-ML/packnet-sfm/issues/191 Having the similar issue on my side when using your docker image as well. Please can you give a hand? Thanks.

ArduinoHocam avatar Nov 25 '21 13:11 ArduinoHocam