relbench icon indicating copy to clipboard operation
relbench copied to clipboard

Add arxiv dataset to RelBench

Open PKUTHM opened this issue 9 months ago • 4 comments

Add arxiv dataset to RelBench

  • Dataset contains paper citation relationships.
  • Data files: 1Paper.csv, 2Category.csv, 3Citation.csv, etc.
  • Dataset source: https://www.dropbox.com/scl/fi/tjj6r1fqikt4j0rz4qomu/db.zip
  • SHA256 hash: ff9e03e467e28df959d08c79c453db1f31b525f07ff3c0e0b5e571e732acc63f
  • For more details: https://github.com/PKUTHM/arxiv-physics

PKUTHM avatar Feb 21 '25 11:02 PKUTHM

Thanks for the contribution @PKUTHM ! @kexinhuang12345 can you please upload this database and let me know so that I can merge it? Thanks

rishabh-ranjan avatar Feb 26 '25 00:02 rishabh-ranjan

Hi @PKUTHM, to maintain uniformity with RelBench, we would like to have some tasks defined on this database before we can merge the PR. Can you please contribute some associated tasks: at least one each of entity classification, entity regression and recommendation? You can refer to existing tasks for inspiration and use the example scripts to run RDL on your tasks. We have found that adding new tasks is fairly light coding work, but designing the task to be not to easy but still predictable reuires some iteration of design choices such as the task timedelta, etc. Thanks! And please let me know the expected timeline you have in mind for when you will be able to get this done?

rishabh-ranjan avatar Feb 26 '25 16:02 rishabh-ranjan

We will happily acknowledge your contribution on the RelBench website and in upcoming releases!

rishabh-ranjan avatar Feb 26 '25 16:02 rishabh-ranjan

I'm working on adding tasks to rel-arxiv. Will make a PR soon.

fengyuli-dev avatar Mar 12 '25 22:03 fengyuli-dev