cotitan

NER任务，换了数据集，训练时NER loss出现负数

4

您好～我想用你的代码跑自己的数据，我的数据共有十三个实体类别。现在修改到能跑起来了，但是跑起来之后NER LOSS出现负数，如下图，我使用的是IDCNN, iob标注格式。 ``` 2018-03-22 18:32:19,216 - log/train.log - INFO - iteration:1 step:100/1449, NER loss:14548.164062 2018-03-22 18:32:24,091 - log/train.log - INFO - iteration:1 step:200/1449, NER loss:3423.436279 2018-03-22 18:32:28,313 - log/train.log...

is there a vocabulary for xlnet

3

I wonder if there is a vocabulary for xlnet, so that giving a sentence, I could generate input_ids according to this vocab, instead of getting it from prepro_utils.encode_ids()

if-statement on projecting embedding to hidden size

1

I found that in models/UTransformer.py:110&194, you have the following codes: ``` self.proj_flag = False if(embedding_size == hidden_size): self.embedding_proj = nn.Linear(embedding_size, hidden_size, bias=False) self.proj_flag = True ``` I'm confused that you...

What's the version of pytorch that you use?

1

I have trouble running this code. At first I cannot train, after modifying the code, I am able to train the network. But now I have trouble in eval_rouge, and...