mrc-for-flat-nested-ner icon indicating copy to clipboard operation
mrc-for-flat-nested-ner copied to clipboard

Published 20 hours ago • verified publisher icon ShannonAI

Can separate the entity_label evaluation results?

Open minstar opened this issue 4 years ago • 1 comments

there are various labels (e.g., "ORG", "LOC", "MISC" etc.). Is there any way to evaluate separately? evaluate.py always shows overall results I think.

minstar avatar Oct 13 '20 13:10 minstar

@minstar evaluate.py actually run self.validation_step defined in trainer.py. I recommend to read pytorch-lightning documents to learn more about its mechanism and implement your own metrics

YuxianMeng avatar Oct 20 '20 02:10 YuxianMeng