autolabel icon indicating copy to clipboard operation
autolabel copied to clipboard

[Feature Request]: Add partial match F1 score to NER

Open rajasbansal opened this issue 2 years ago • 0 comments

Is your feature request related to a problem? Please describe. Currently NER uses the library nervaluate based on the SemEval framework of evaluation. More details on this evaluation here - https://www.davidsbatista.net/blog/2018/05/09/Named_Entity_Evaluation/. We currently just support strict matching of the ground truth surface string and predicted entity surface string. Add support for partial matches to be considered while calculating accuracy.

Describe the solution you'd like Add partial matches f1 from the nervaluate evaluator output.

Additional context image

rajasbansal avatar Jul 14 '23 05:07 rajasbansal