RuntimeError: CUDNN_STATUS_BAD_PARAM

[hehichens]

Hello, i got an error like this.

Traceback (most recent call last):
  File "main.py", line 634, in <module>
    train(data)
  File "main.py", line 456, in train
    loss, perplexity, tag_seq_forward, tag_seq_backward, tag_seq = model.loss('model1', batch_word[0], batch_features[0], batch_wordlen[0], batch_char[0], batch_charlen[0], batch_charrecover[0], batch_label[0], lm_seq_tensor[0], mask[0])
  File "/hdisk4t/sym_ll/sym_ll/NER/Cross-Domain_NER-master/supervised_domain_adaptation/model/seqmodel.py", line 60, in loss
    outs_forward, outs_backward, outs = self.word_hidden(mode, word_inputs, feature_inputs, word_seq_lengths, char_inputs, char_seq_lengths, char_seq_recover)
  File "/home/sym_ll/hdisk4t/sym_ll/anaconda3/envs/torch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 357, in __call__
    result = self.forward(*input, **kwargs)
  File "/hdisk4t/sym_ll/sym_ll/NER/Cross-Domain_NER-master/supervised_domain_adaptation/model/wordsequence.py", line 112, in forward
    word_represent = self.wordrep(word_inputs,feature_inputs, word_seq_lengths, char_inputs, char_seq_lengths, char_seq_recover)
  File "/home/sym_ll/hdisk4t/sym_ll/anaconda3/envs/torch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 357, in __call__
    result = self.forward(*input, **kwargs)
  File "/hdisk4t/sym_ll/sym_ll/NER/Cross-Domain_NER-master/supervised_domain_adaptation/model/wordrep.py", line 98, in forward
    char_features = self.char_feature.get_last_hiddens(char_inputs, char_seq_lengths.cpu().numpy())
  File "/hdisk4t/sym_ll/sym_ll/NER/Cross-Domain_NER-master/supervised_domain_adaptation/model/charcnn.py", line 51, in get_last_hiddens
    char_cnn_out = self.char_cnn(char_embeds)
  File "/home/sym_ll/hdisk4t/sym_ll/anaconda3/envs/torch/lib/python3.6/site-packages/torch/nn/modules/module.py", line 357, in __call__
    result = self.forward(*input, **kwargs)
  File "/home/sym_ll/hdisk4t/sym_ll/anaconda3/envs/torch/lib/python3.6/site-packages/torch/nn/modules/conv.py", line 168, in forward
    self.padding, self.dilation, self.groups)
  File "/home/sym_ll/hdisk4t/sym_ll/anaconda3/envs/torch/lib/python3.6/site-packages/torch/nn/functional.py", line 54, in conv1d
    return f(input, weight, bias)
RuntimeError: CUDNN_STATUS_BAD_PARAM