electra icon indicating copy to clipboard operation
electra copied to clipboard

Published 20 hours ago • verified publisher icon google-research

Electra Vocabulary

Open avinashsai opened this issue 4 years ago • 1 comments

Hi,

I have a query about Electra's vocabulary. In contrast to other models where vocabulary words are clearly seen, why are words in Electra vocab [unused0], [unused1]..... except for a few special tokens ?

avinashsai avatar Jun 07 '21 05:06 avinashsai

Hi

This is the vocabulary from the original BERT implementation, a quick Google search gave me this: https://stackoverflow.com/questions/62452271/understanding-bert-vocab-unusedxxx-tokens

claeyzre avatar Jun 24 '21 09:06 claeyzre