allennlp icon indicating copy to clipboard operation
allennlp copied to clipboard

RoBERTa on SuperGLUE's CommitmentBank task

Open dirkgr opened this issue 4 years ago • 0 comments

CommitmentBank is one of the tasks of the SuperGLUE benchmark. The task is to re-trace the steps of Facebook's RoBERTa paper (https://arxiv.org/pdf/1907.11692.pdf) and build an AllenNLP config that reads the CommitmentBank data and fine-tunes a model on it. We expect scores in the range of their entry on the SuperGLUE leaderboard.

This can be formulated as a classification task, using the TransformerClassificationTT model, analogous to the IMDB model. You can start with the experiment config and dataset reading step from IMDB, and adapt them to your needs.

dirkgr avatar Feb 18 '21 23:02 dirkgr