argilla icon indicating copy to clipboard operation
argilla copied to clipboard

Add comments/notes to annotation datasets to share with teammates.

Open davidberenstein1957 opened this issue 2 years ago • 6 comments

Is your feature request related to a problem? Please describe. I want to collaborate on annotation with my team along with annotation guidelines. Also, I would like to keep track of potential uncertainties and potential comments of teammates during my annotation process.

"When labeling a large corpus, it becomes important to take notes about an interesting data point or add additional metadata like a set of tags or flags to a data point to come back to it quickly. The current data model does not support such flags or custom notes."

Describe the solution you'd like A logbook of comments and a document containing an introduction to the dataset.

"Extend the data model with additional tags and notes attributes which can be queried or filtered by, and are editable during hand annotation mode. Optionally, making certain fields of metadata editable during the hand labeling exercise could also fulfil the intention."

Describe alternatives you've considered I´ve considered having a separate document and log, but ideally, I want to have this together to avoid separation.

"One might need to keep track of the interesting / confusing data points manually, or just not validate them till the very end, which causes friction."

Additional context Kind off aligns with this issue argilla-io/rubrix-roadmap#89

" This is a productivity booster and helps you annotate faster, also helps in validating your annotations later by another annotator if they exchange data specific notes or fixes. "

davidberenstein1957 avatar Oct 25 '22 15:10 davidberenstein1957

This would be a great addition indeed!

dvsrepo avatar Oct 25 '22 20:10 dvsrepo

https://github.com/argilla-io/argilla/issues/1873

davidberenstein1957 avatar Nov 23 '22 09:11 davidberenstein1957

+1

dhruvsakalley avatar Dec 20 '22 21:12 dhruvsakalley

This issue is stale because it has been open for 90 days with no activity.

github-actions[bot] avatar Nov 28 '23 01:11 github-actions[bot]

I think this is also a thing that came up during the awesome-argilla-datasets efforts, where we needed to discuss examples and eventually needed to be reflected in the annotation guidelines as context for everyone to use lateron.

davidberenstein1957 avatar Dec 11 '23 10:12 davidberenstein1957

This is something useful way to provide a reason when discarding records

frascuchon avatar Dec 18 '23 10:12 frascuchon