openreview-py
openreview-py copied to clipboard
How to link reviewers and their reviews as a PC on conference
I'm trying to analyze the reviews on a venue I was a PC using APIv2.
I was able to retrieve the reviewers and reviews per submission following the documentation. However, when a submission has reviewers that didn't submitted their reviews the assignment is no one to one. I was looking for a way to match the assigned reviewers and their reviews.
I was thinking about:
- getting the anonymous name and then do the match by hand
- find the reviews by the reviewer, and then sift through the submission
Is there a better way of doing it with the API? What is the supposed way to retrieve this information?
import openreview
client = openreview.api.OpenReviewClient(baseurl='https://api2.openreview.net', username='**', password='**')
venue_id="**"
venue_group = client.get_group(venue_id)
# strings
submission_name = venue_group.content['submission_name']['value']
review_name = venue_group.content['review_name']['value']
submissions = client.get_all_notes(invitation=f'{venue_id}/-/{submission_name}', details='replies')
for submission in submissions:
# Assigned reviewers per submission
submission_reviewers = client.get_group(f'{venue_id}/{submission_name}{submission.number}/Reviewers')
# Replies
# sift through the replies for the official reviews (maybe useful if I want to compute interactions as well)
# reviews = [r for r in submission.details['directReplies'] if f'{venue_id}/{submission_name}{submission.number}/-/{review_name}' in r['invitations']]
# direct reviews from notes
reviews = client.get_all_notes(invitation=f'{venue_id}/{submission_name}{submission.number}/-/{review_name}')
# how to link the submission_reviewers and the reviews?