bert4torch icon indicating copy to clipboard operation
bert4torch copied to clipboard

RuntimeError: masked_select: expected BoolTensor or ByteTensor for mask

Open zbbwss opened this issue 2 years ago • 8 comments

Traceback (most recent call last): File "C:/Users/Administrator/Desktop/bert_crf/train.py", line 191, in model.fit(train_dataloader, epochs=20, steps_per_epoch=None, callbacks=[evaluator]) File "D:\python36\lib\site-packages\bert4torch\models.py", line 213, in fit output, loss, loss_detail = self.train_step(train_X, train_y, grad_accumulation_steps) File "D:\python36\lib\site-packages\bert4torch\models.py", line 131, in train_step loss_detail = self.criterion(output, train_y) File "D:\python36\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl return forward_call(*input, **kwargs) File "C:/Users/Administrator/Desktop/bert_crf/train.py", line 122, in forward return model.crf.neg_log_likelihood_loss(*outputs, labels) File "D:\python36\lib\site-packages\bert4torch\layers.py", line 913, in neg_log_likelihood_loss forward_score, scores = self._forward_alg(feats, mask) File "D:\python36\lib\site-packages\bert4torch\layers.py", line 862, in _forward_alg masked_cur_partition = cur_partition.masked_select(mask_idx) # [x * tag_size]

zbbwss avatar Jul 05 '22 05:07 zbbwss

测试运行的脚本是ner任务: /Tongjilibo/bert4torch/blob/master/examples/sequence_labeling/task_sequence_labeling_ner_crf.py 运行环境 windows10 pycharm 最新版本0.1.6的bert4torch torch==1.10

zbbwss avatar Jul 05 '22 06:07 zbbwss

image

zbbwss avatar Jul 05 '22 06:07 zbbwss

已经自我修复了 ,不知道是不是只有我自己的问题 还是说所有的都是这样的

zbbwss avatar Jul 05 '22 06:07 zbbwss

已经自我修复了 ,不知道是不是只有我自己的问题 还是说所有的都是这样的

你是用的pip版本吗?pip上的0.1.6版本当时配合的task_sequence_labeling_ner_crf.py也是attention_mask转为bool类型的,后续我在CRF内部自己转bool()类型了,你可以用git上的最新代码试下,应该就没刚刚的问题了

Tongjilibo avatar Jul 05 '22 07:07 Tongjilibo

是的用 pip install bert4torch 进行安装

zbbwss avatar Jul 05 '22 08:07 zbbwss

直接git 是可以的 没有问题的

zbbwss avatar Jul 05 '22 08:07 zbbwss

image

zbbwss avatar Jul 05 '22 08:07 zbbwss

image

刚看到,你这边这个问题还有吗?

Tongjilibo avatar Jul 12 '22 05:07 Tongjilibo