Validation by exclusion criteria

[esyriani]

Currently, in the validation step of a screening phase, we randomly sample from X% of all rejected papers regardless of their exclusion criteria. It is preferable to have the option of filtering only specific exclusion criteria to sample from. There should be an option to specify which exclusion criteria (or none by default) should be considered when randomly selecting the papers.

Here is the workaround I use currently

Retriving papers of a specific exclusion criteria

Example for the second screening phase of a project and exclusion criteria id=43 (EC0), 4 reviewers.

SELECT paper.id, paper.bibtexKey, paper.title, screening_time, ref_value AS exclusion, CASE WHEN user_id = 3 THEN 'Alice' WHEN user_id = 488 THEN 'Bob' WHEN user_id = 531 THEN 'Charlie' WHEN user_id = 578 THEN 'Dalia' END AS user_name FROM screening_paper INNER JOIN ref_exclusioncrieria ON ref_exclusioncrieria.ref_id = screening_paper.exclusion_criteria INNER JOIN paper ON paper.id = screening_paper.paper_id WHERE screening_phase = 6 AND exclusion_criteria = 43 ORDER BY bibtexKey, screening_time, user_name