scibert icon indicating copy to clipboard operation
scibert copied to clipboard

Published 20 hours ago • verified publisher icon allenai

SciVocab Preparation

Open kuldeep7688 opened this issue 5 years ago • 1 comments

Can you please elaborate a bit more how you used Sentencepiece to build SciVocab?

kuldeep7688 avatar Oct 15 '19 06:10 kuldeep7688

It is just one function call: https://github.com/allenai/scibert/blob/master/scripts/cheatsheet.txt#L6 The output format is slightly different than what BERT expects, so we manually fixed after it was generated.

ibeltagy avatar Oct 18 '19 13:10 ibeltagy