nutonomy_pointpillars icon indicating copy to clipboard operation
nutonomy_pointpillars copied to clipboard

[999] Call to cuInit results in CUDA_ERROR_UNKNOWN: when create_data.py is run

Open MohsinMohammad opened this issue 2 years ago • 0 comments

Facing below error

$ python create_data.py create_kitti_info_file --data_path=KITTI_DATASET_ROOT /home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/envvars.py:17: NumbaWarning: Environment variables with the 'NUMBAPRO' prefix are deprecated and consequently ignored, found use of NUMBAPRO_CUDA_DRIVER=/usr/lib/x86_64-linux-gnu/libcuda.so.

For more information about alternatives visit: ('https://numba.pydata.org/numba-doc/latest/cuda/overview.html', '#cudatoolkit-lookup') warnings.warn(errors.NumbaWarning(msg)) /home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/envvars.py:17: NumbaWarning: Environment variables with the 'NUMBAPRO' prefix are deprecated and consequently ignored, found use of NUMBAPRO_NVVM=/usr/local/cuda/nvvm/lib64/libnvvm.so.

For more information about alternatives visit: ('https://numba.pydata.org/numba-doc/latest/cuda/overview.html', '#cudatoolkit-lookup') warnings.warn(errors.NumbaWarning(msg)) /home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/envvars.py:17: NumbaWarning: Environment variables with the 'NUMBAPRO' prefix are deprecated and consequently ignored, found use of NUMBAPRO_LIBDEVICE=/usr/local/cuda/nvvm/libdevice.

For more information about alternatives visit: ('https://numba.pydata.org/numba-doc/latest/cuda/overview.html', '#cudatoolkit-lookup') warnings.warn(errors.NumbaWarning(msg)) Traceback (most recent call last): File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/driver.py", line 237, in initialize self.cuInit(0) File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/driver.py", line 300, in safe_cuda_api_call self._check_error(fname, retcode) File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/driver.py", line 335, in _check_error raise CudaAPIError(retcode, msg) numba.cuda.cudadrv.driver.CudaAPIError: [999] Call to cuInit results in CUDA_ERROR_UNKNOWN

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "create_data.py", line 9, in from second.core import box_np_ops File "/mnt/d/Downloads/POINTPILLARS/nutonomy_pointpillars/second/core/box_np_ops.py", line 7, in from second.core.non_max_suppression.nms_gpu import rotate_iou_gpu_eval File "/mnt/d/Downloads/POINTPILLARS/nutonomy_pointpillars/second/core/non_max_suppression/init.py", line 2, in from second.core.non_max_suppression.nms_gpu import (nms_gpu, rotate_iou_gpu, File "/mnt/d/Downloads/POINTPILLARS/nutonomy_pointpillars/second/core/non_max_suppression/nms_gpu.py", line 36, in @cuda.jit('(int64, float32, float32[:, :], uint64[:])') File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/decorators.py", line 95, in kernel_jit return Dispatcher(func, [func_or_sig], targetoptions=targetoptions) File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/compiler.py", line 899, in init self.compile(sigs[0]) File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/compiler.py", line 1102, in compile kernel.bind() File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/compiler.py", line 590, in bind self._func.get() File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/compiler.py", line 433, in get cuctx = get_context() File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/devices.py", line 212, in get_context return _runtime.get_or_create_context(devnum) File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/devices.py", line 138, in get_or_create_context return self._get_or_create_context_uncached(devnum) File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/devices.py", line 151, in _get_or_create_context_uncached with driver.get_active_context() as ac: File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/driver.py", line 393, in enter driver.cuCtxGetCurrent(byref(hctx)) File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/driver.py", line 280, in getattr self.initialize() File "/home/mohsin/anaconda3/envs/pointpillars/lib/python3.6/site-packages/numba/cuda/cudadrv/driver.py", line 240, in initialize raise CudaSupportError("Error at driver init: \n%s:" % e) numba.cuda.cudadrv.error.CudaSupportError: Error at driver init: [999] Call to cuInit results in CUDA_ERROR_UNKNOWN:

I have completed the setup mentioned in readme. Downloaded mentioned Kitti datasets and placed them as per the directory structure specified. └── KITTI_DATASET_ROOT ├── training <-- 7481 train data | ├── image_2 <-- for visualization | ├── calib | ├── label_2 | ├── velodyne | └── velodyne_reduced <-- empty directory └── testing <-- 7580 test data ├── image_2 <-- for visualization ├── calib ├── velodyne └── velodyne_reduced <-- empty directory placed this KITTI_DATASET_ROOT inside nutonomy_pointpillars/second/data/ImageSets/

$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2021 NVIDIA Corporation Built on Sun_Aug_15_21:14:11_PDT_2021 Cuda compilation tools, release 11.4, V11.4.120 Build cuda_11.4.r11.4/compiler.30300941_0

CUDA Information when $ numba -s command is run: CUDA Information CUDA Device Initialized : False CUDA Driver Version : ? CUDA Detect Output: None CUDA Libraries Test Output: None

I am trying this in WSL.

MohsinMohammad avatar May 08 '22 05:05 MohsinMohammad