How to reproduce the result as Table 3 described in the paper?

[Nicozwy]

Hi, I am trying to reproduce the result as described in Table 3 of the paper https://arxiv.org/abs/1903.10676, what should I do to make it? Besides, if I want to use the model to make evaluation on my dataset, are there some additional work that I should do?

Thank you for your excellent work!

[ibeltagy]

Just follow the instructions in the readme, and you should be able to reproduce the results of frozen embeddings. The finetuning experiments require the code in this PR as well https://github.com/allenai/scibert/pull/45