Open-Assistant
Open-Assistant copied to clipboard
LAION-AI
Speeding up the annotation work: less clicks!
The annotation website become better every release! Nevertheless, I propose some UX improvements, with the goal of minimizing clicks.
1. Please avoid the double step (review -> confirm):
Just collapse in a single unique button SUBMIT
2. if a user want to skip, please avoid the double step (skip -> note box):
I'd propose to have a separate "SKIP & NOTE" button on the left of the SKIP button, or better having a SKIP button with a drop-box with pre-selected reasons and a final option to write a note, like
- I don't understand the content
- I'm not a domain expert
- blablabla
- Let me add a note
3. Enable function keys
Because Yannic is a vim enthusiast (if I well understood / I'm joking), It could be great to avoid clicks, allowing key functions (:w) or a more common Ctrl-S (here I'm serious).
Another proposal:
The spam verification yes/no question is tedious. If I (as annotator) believe that the content is spam, I probably don't want to elaborate. Right?
So my best option is to have a big RED button SPAM to be added maybe on the left of the SKIP. As a second option, SPAM could be a reason to SKIP, to be added on the dropbox list mentioned in my previous comment.
BTW, maybe the same for the "BAD REPLY" Yes/No question. Isn't this question a duplicate of the "low quality" radiobox rate line?
These would be nice to have - perhaps the right side of the "Skip" button could have a small arrow that opens a dropdown (drop-up?) menu that allows for skipping with a note, and maybe that dialog should have the preset options as a dropdown, and the text entry as an "Other..." option. I definitely agree with the spam idea; maybe the rest of the fields should be grayed out when "Is the message spam?" is set to "Yes".
Keep aware that the Review step will have at least temporary meaning for reviewing Markdown formatting once #1350 / #837 is completed. Eventually with a full fledged Markdown editor we can finally reduce it to one step
About №2. If it'd be removed, let's not to do actual skip if a user has typed anything into the answer box, instead of — pop-up: "You have some text here. Do you really want to skip?".
SOLUTION: add keyboard shortcuts for annotation. press tab tab to skip, enter enter to submit, and space to set as not spam. Not english gets a keybind too since it is so common.
