ST-PlusPlus icon indicating copy to clipboard operation
ST-PlusPlus copied to clipboard

RuntimeError: cuDNN error: CUDNN_STATUS_BAD_PARAM

Open daeunni opened this issue 2 years ago • 2 comments

Hi, @LiheYoung Thanks for your nice work. Btw, I encountered error like below. It seems like kinda cuDNN error, but I have no idea to deal with. How can I fix it?

  File "/home/daeun/anaconda3/envs/cuda114/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/daeun/anaconda3/envs/cuda114/lib/python3.8/site-packages/torch/nn/modules/container.py", line 117, in forward
    input = module(input)
  File "/home/daeun/anaconda3/envs/cuda114/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/d1/daeun/semi/ST-PlusPlus/model/backbone/resnet.py", line 78, in forward
    out = self.conv1(x)
  File "/home/daeun/anaconda3/envs/cuda114/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/daeun/anaconda3/envs/cuda114/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 423, in forward
    return self._conv_forward(input, self.weight)
  File "/home/daeun/anaconda3/envs/cuda114/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
    return F.conv2d(input, weight, self.bias, self.stride,
RuntimeError: cuDNN error: CUDNN_STATUS_BAD_PARAM

daeunni avatar Mar 26 '23 10:03 daeunni

I used this shell.

export semi_setting='cityscapes/1_8/split_0'

CUDA_VISIBLE_DEVICES=0,1 python -W ignore main.py \
  --dataset cityscapes --data-root /d1/daeun/dataset/cityscape \
  --batch-size 8 --backbone resnet50 --model deeplabv3plus \
  --labeled-id-path dataset/splits/$semi_setting/labeled.txt \
  --unlabeled-id-path dataset/splits/$semi_setting/unlabeled.txt \
  --pseudo-mask-path outdir/pseudo_masks/$semi_setting \
  --save-path outdir/models/$semi_setting

daeunni avatar Mar 26 '23 10:03 daeunni

Hi, I have the same problem. Have you solved it?

A0268 avatar Jul 23 '24 11:07 A0268