pytorch-bert-crf-ner icon indicating copy to clipboard operation
pytorch-bert-crf-ner copied to clipboard

Add new entity does not work

Open dgks0n opened this issue 4 years ago • 5 comments

Hi there,

I am interested in your code and I tried to added new entity into training dataset. After that, I change few things to ensure that the code can be run on the new list of entities. Nevertheless, it does not work. After 18 epoch, the trained model can not recognize the new entity. My entity is EMAIL, PHONE_NUMBER.

So, is there any special thing that I should change before train the model with the new list of entities?

dgks0n avatar Apr 08 '20 09:04 dgks0n

Does a new entity mean a new tag?

I'm also curious about this, have you solved adding new tags?

kwangrok92 avatar May 19 '20 09:05 kwangrok92

@kwangrok92 Not yet, I am waiting for reply from author, but he did not give any feedback.

dgks0n avatar May 26 '20 07:05 dgks0n

@dgks0n I'm also waiting 👍

kwangrok92 avatar May 26 '20 07:05 kwangrok92

did you modify this file?? https://github.com/eagle705/pytorch-bert-crf-ner/blob/master/experiments/base_model_with_crf_val/ner_to_index.json

eagle705 avatar Sep 13 '20 15:09 eagle705

@eagle705 I did it. I added new tags are B-EMA (email), I-IMA and of course, the data also has been labeled. However, it does not work.

dgks0n avatar Oct 01 '20 07:10 dgks0n