Bulk unrate of ratings in a Book

Is your feature request related to a problem? Please describe. As a relevance engineer, I would like to be able to reset the ratings of any items that were rated unrateable, allowing them to return to the pool of query document pairs to be rated. I can manually select an individual judgment, then manually select unrate from the rating screen, to accomplish the task.

Describe the solution you'd like Add a selection check box for ratings on the Judgments page, allowing me to select 1 or more items. Add an action button to unrate selected. There could be other actions associated with the selected items, but unrate is the only one that is currently in my workflow.

Additional context I imagine select check box on each row, action button or menu at the top.

This feature would also be useful for our use case. We have many 'newsy' quries where the most relevant documents quickly become stale as new articles are written. Being able to easily un-rate all of those query-doc pairs would be handy.

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Please do advocate for this issue and ideally submit a patch to get the attention of the maintainers!