inception icon indicating copy to clipboard operation
inception copied to clipboard

Automatic Names Entity based on agreement threshold

Open n0k0m3 opened this issue 3 years ago • 2 comments

Is your feature request related to a problem? Please describe. I'm working with a team of 10 (2 curators) on 100+ documents and want to make the curation process more tolerable

Describe the solution you'd like ~~Based on a certain agreement threshold (customizable), curator has a "suggested tag" to select on their raw text.~~ (thanks @reckart for pointing me at the remerge button and pre-merge strategies) Also, would be great if there's also a "suggested tag" from the annotator with the highest average inter-annotator agreement score

Describe alternatives you've considered No alternative considered

n0k0m3 avatar Jan 25 '22 00:01 n0k0m3

Thank you for the suggestions.

Have you seen the option for a threshold-based pre-merge? When you open a document for curation for the first time, click on the "remerge" button and switch to the threshold-based strategy.

reckart avatar Jan 25 '22 06:01 reckart

That was really cool, I thought the remerge button was the same as the refresh/undo button in annotator's UI. Thanks for the tips. I found the 3 merge strategies really useful.

I still want to request (feature) strategy of prefer tags from annotator with highest agreement score.

n0k0m3 avatar Jan 25 '22 17:01 n0k0m3