argilla
argilla copied to clipboard
Add comments/notes to annotation datasets to share with teammates.
Is your feature request related to a problem? Please describe. I want to collaborate on annotation with my team along with annotation guidelines. Also, I would like to keep track of potential uncertainties and potential comments of teammates during my annotation process.
"When labeling a large corpus, it becomes important to take notes about an interesting data point or add additional metadata like a set of tags or flags to a data point to come back to it quickly. The current data model does not support such flags or custom notes."
Describe the solution you'd like A logbook of comments and a document containing an introduction to the dataset.
"Extend the data model with additional tags and notes attributes which can be queried or filtered by, and are editable during hand annotation mode. Optionally, making certain fields of metadata editable during the hand labeling exercise could also fulfil the intention."
Describe alternatives you've considered I´ve considered having a separate document and log, but ideally, I want to have this together to avoid separation.
"One might need to keep track of the interesting / confusing data points manually, or just not validate them till the very end, which causes friction."
Additional context Kind off aligns with this issue argilla-io/rubrix-roadmap#89
" This is a productivity booster and helps you annotate faster, also helps in validating your annotations later by another annotator if they exchange data specific notes or fixes. "
This would be a great addition indeed!
https://github.com/argilla-io/argilla/issues/1873
+1
This issue is stale because it has been open for 90 days with no activity.
I think this is also a thing that came up during the awesome-argilla-datasets efforts, where we needed to discuss examples and eventually needed to be reflected in the annotation guidelines as context for everyone to use lateron.
This is something useful way to provide a reason when discarding records