edx-ora2 icon indicating copy to clipboard operation
edx-ora2 copied to clipboard

"Escalation" workflow to break ties, handle large discrepencies in feedback.

Open e0d opened this issue 1 year ago • 1 comments

flexibility to add graders/staff tosome submissions as necessary(e.g. when we see 2 peer scoresdiffer by a huge amount- Ability to edit a single instance of a peer grade of an ora response (teacher grade overrides one of the peer scores and then recalculates)

e0d avatar Jun 03 '23 00:06 e0d

Yes, I often see requests for Faculty Override. I think any submission should have the option of faculty override for simplicity sake. And maybe a simple way to do this is have a "grade confidence" calculation or something that just highlights submissions with a wide deviation between scores (red for wide deviation. Green for small deviation. yellow in between), and then faculty can look at those and determine if they need to intervene.

jswope00 avatar Jul 25 '23 14:07 jswope00