Review Anonymity

[danielBingham]

As a user I want to be able to receive double blind reviews so I can be confident that my review feedback is unbiased.

Story Background

What is the history or background behind this story? What context the developer researching or implementing this story need?

There's a debate going in academia as to whether open reviews or double blind reviews are better. There are strong arguments to be made on both sides, and it feels like there isn't a clear answer. So we want to let the authors choose whether they want reviews to be double blind or open. We need to build a double blind review system and then provide a switch on the publish page allowing the author to choose which it is. Then we need to signal to the reviewers somehow which it is.

Acceptance Criteria

At what point is this story considered "done"?

• We provide a switch on the publish page allowing authors to choose between double blind and open reviews.
• Double blind reviews do not reveal any user information, for either the reviewers or the authors, anywhere. That includes in the code (you shouldn't be able to discover who left a review, or comments, or authored the paper by inspecting the review pages anywhere).
  • We won't try to strip author information out of the submitted PDF, we'll leave that as an exercise for the user.
• Double blind reviews allow authors to upload a final version of the PDF before publishing that adds authors back in.

Dependencies

What stories does this one depend on? What do we need to do first before we can call this one done?