Visualize ICLR 2023 OpenReview Data

ICLR 2023 Paper submission analysis from https://openreview.net/group?id=ICLR.cc/2023/Conference

Requirements

• Install requirements

pip install wordcloud nltk pandas imageio selenium tqdm

• Download several nltk-related packages for language processing

import nltk
nltk.download('punkt')
nltk.download('averaged_perceptron_tagger')
nltk.download('wordnet')
nltk.download('stopwords')

• If you got anything wrong when calling webdriver.Edge('msedgedriver.exe'), you can

  • Delete msedgedriver.exe since it may only work on my computer (Windows 10)

  • Install Microsoft Edge (Chromium): Ensure you have installed Microsoft Edge (Chromium). To confirm that you have Microsoft Edge (Chromium) installed, go to edge://settings/help in the browser, and verify the version number is Version 75 or later.

  • Download Microsoft Edge Driver: Go to edge://settings/help to get the version of Edge.

  • Navigate to the Microsoft Edge Driver downloads page and download the driver that matches the Edge version number.

  From https://stackoverflow.com/questions/63529124/how-to-open-up-microsoft-edge-using-selenium-and-python

Crawl Data

1. Run crawl_paperlist.py to crawl the list of papers (~0.5h).

python crawl_paperlist.py --year 2023

Paper List

crawl_paperlist.py will miss several papers for some errors. The full paper list are as follows:

• Year 2022 (3,407 submissions in total):

  • sources/ICLR-2022.csv

  • sources/ICLR-2022.md

• Year 2023 (4,966 submissions in total):

  • sources/ICLR-2023.csv

  • sources/ICLR-2023.md

Visualization

Keywords and Title

• Keywords Frequency The top 50 common keywords (uncased) and their frequency:

• Top-10 Ranking between 2022 and 2023 (full list please refer to keywords.md)

• Ranking Changes of Top-50 keywords

• Keywords Cloud The word clouds formed by keywords of submissions show the hot topics including deep learning, reinforcement learning, representation learning, graph neural network, etc.

• Title Keywords Frequency The top 50 common title keywords (uncased) and their frequency:

• Top-10 Ranking between 2022 and 2023 (full list please refer to title.md)

• Ranking Changes of Top-50 Title keywords

• Title Keywords Cloud The word clouds formed by keywords of submission titles:

Related projects

• https://github.com/evanzd/ICLR2021-OpenReviewData
• https://github.com/fedebotu/ICLR2022-OpenReviewData
• https://github.com/EdisonLeeeee/ICLR2022-OpenReviewData