Bert-Multi-Label-Text-Classification icon indicating copy to clipboard operation
Bert-Multi-Label-Text-Classification copied to clipboard

I have train almost 80thousand examples within 2000 labels,valid acc almost 92%,but test result all example prob is blew 0.01.

Open w279805299 opened this issue 5 years ago • 6 comments

I have trained almost 80thousand examples within 2000 labels,valid acc almost 92%,but test result all example prob is blew 0.01. I have tried tranning examples to predict.

w279805299 avatar Sep 19 '19 08:09 w279805299

I have trained almost 80thousand examples within 2000 labels,valid acc almost 92%,but test result all example prob is blew 0.01. I have tried tranning examples to predict.

hello, have you solved this problem?

qiu-nian avatar Oct 16 '19 07:10 qiu-nian

When having a large number of labels and the number of actual labels for each sample is small, the loss function needs to be re-considered, otherwise the accuracy is unreliable

bimhud avatar Oct 23 '19 06:10 bimhud

I have trained almost 80thousand examples within 2000 labels,valid acc almost 92%,but test result all example prob is blew 0.01. I have tried tranning examples to predict.

hello have you solved this problem? I meet this problem too

sunxiaowu avatar Nov 20 '19 08:11 sunxiaowu

When having a large number of labels and the number of actual labels for each sample is small, the loss function needs to be re-considered, otherwise the accuracy is unreliable

so I should change the loss function? should I modify the method of accuracy ?

sunxiaowu avatar Nov 20 '19 09:11 sunxiaowu

我也遇到了同样的问题,实际的分类效果非常差

xiaoyichao avatar Dec 23 '19 12:12 xiaoyichao

是的,我也遇到了,66个类别,准确率不能反映真实情况

wl915634785 avatar Jan 04 '22 01:01 wl915634785