openreview-py icon indicating copy to clipboard operation
openreview-py copied to clipboard

ARR: Update emergency aggregate score workflow

Open haroldrubio opened this issue 9 months ago • 0 comments

When a user submits an emergency reviewer or metareviewer form, the process function updates all aggregate scores by adding 10, but this destroys the meaning of the previous aggregate scores, especially when the emergency reviewing period has not yet started.

The new proposed solution is to compute aggregate scores by:

  1. Posting these scores to a new edge invitation Emergency_Score
  2. Sum across the affinity scores, instead of just the aggregate scores
  3. Wait until the reviewing deadline passes, and then compute the scores to avoid confusion during the regular reassignment period

haroldrubio avatar May 03 '24 14:05 haroldrubio