acl-anthology icon indicating copy to clipboard operation
acl-anthology copied to clipboard

Mark best / outstanding papers

Open mjpost opened this issue 5 years ago • 15 comments

It would be nice to mark best and outstanding papers and other awards, both in the list view and on the paper page. Maybe with a yellow star: ⭐.

Resources:

  • ACL: https://aclweb.org/aclwiki/Best_paper_awards
  • Other conferences: https://jeffhuang.com/best_paper_awards.html

mjpost avatar Apr 08 '19 16:04 mjpost

COLING 2018: http://coling2018.org/coling-2018-best-papers/

evanmiltenburg avatar Apr 12 '19 07:04 evanmiltenburg

Do we mark best papers in the XML, or add another YAML source? I think I'd lean towards the former.

mbollmann avatar Apr 14 '19 19:04 mbollmann

Yes, in the XML. And we need to be able to handle multiple kinds of awards (best student paper, outstanding paper, test of time, etc). What do you think about this? Maybe

<award>Outstanding paper</award>

mjpost avatar Apr 14 '19 21:04 mjpost

Hi, I can take this up in the rest of this week -- if there is a consensus on how to address this.

pkolachi avatar Jul 17 '19 08:07 pkolachi

That would be awesome! I suggest adding an “award” tag as mentioned above. The hard part is making the annotations. Once they have been made, we could change the format easily with a script.

mjpost avatar Jul 17 '19 12:07 mjpost

Another list: https://naacl2018.wordpress.com/2018/03/22/test-of-time-award-papers/

mjpost avatar Jul 18 '19 03:07 mjpost

Thanks. I'm making progress with this by extending the information in the ACL wiki with more information from archive conference pages. That followed by verifying against the front-matter corresponding to a conference. There are some discrepancies (conflicts) and I don't know what's the best say to resolve these. ACL14 may be an example, where there wasn't a best short paper awarded according to the program, but the ACL wiki says otherwise. Personally, I am all for crowd-fixing any conflicts like these and simply putting together all the information available, but are there better recommendations here?

pkolachi avatar Jul 18 '19 19:07 pkolachi

I don’t know the right answer to ACL 2014 but I would prioritize the most local information, so in this case, the program. You could note discrepancies in a commit message. They can always be fixed later.

mjpost avatar Jul 18 '19 20:07 mjpost

It's several years, but ACL 2014 was actually the first big conference I went to and I only remember two awards. The website says so as well The "ACL 14 best short paper" in the wiki is only listed as an honorable mention on the official website. The official handbook also only lists two: best long paper and best student paper.

akoehn avatar Jul 18 '19 20:07 akoehn

"Outstanding paper", "honorable mention", and others should also be annotated. This is why we have an arbitrary text string for the award.

mjpost avatar Jul 18 '19 21:07 mjpost

Yup, making a tsv table with paperid, title, and the award string that's mentioned anywhere. This is incredibly fun :)

pkolachi avatar Jul 18 '19 21:07 pkolachi

Hi @pkolachi, are you still interested in doing this or did you lose interest? Even just having a CSV / TSV file of the format:

P19-1426	Best Paper

would do the trick.

mjpost avatar Aug 05 '19 18:08 mjpost

Many of these were added in #954. This spreadsheet tracks progress.

mjpost avatar Sep 08 '20 16:09 mjpost

Many of these were added in #954. This spreadsheet tracks progress.

Is the spreadsheet you linked here still up-to-date, @mjpost?

mbollmann avatar Feb 22 '22 18:02 mbollmann

I think so, but it is a first-pass effort, and I think everything needs to be validated. I've shared it with you and added a "verified" column in case your interest is piqued.

mjpost avatar Feb 22 '22 18:02 mjpost