fast-bert icon indicating copy to clipboard operation
fast-bert copied to clipboard

Removed the accuracy_multilabel in favour of accuracy_thresh

Open bharatr21 opened this issue 5 years ago • 2 comments

Fix #23 by removing the redundant accuracy_multilabel function (since accuracy_thresh already has the same functionality)

bharatr21 avatar Jun 06 '19 12:06 bharatr21

when I train a multi-label classifier, accuracy_thresh outputs a different value than accuracy_multilabel. For example, the logged metrics return something like:

eval_accuracy_thresh after epoch 1: 0.876443088054657 
eval_accuracy_multilabel after epoch 1: 0.6985998526160648

Maybe you want to check again how they're factored? I do think they're measuring different things.

lingdoc avatar Jun 19 '20 11:06 lingdoc

@Bharat123rox , @lingdoc - accuracy_thresh is well suited to handle multilabel classification. However, accuracy_multilabel offers alternative, perhaps better handling of multiclass classification, which is independent of a threshold. The problem is that accuracy_multilabel name is misleading, it should rather be accuracy_multiclass.

Pawel-Kranzberg avatar Nov 10 '20 20:11 Pawel-Kranzberg