roberta-squad icon indicating copy to clipboard operation
roberta-squad copied to clipboard

What is "encoder.json" and "vocab.bpe" when I'm running "create_data.ipynb" ?

Open zongshuai818 opened this issue 5 years ago • 1 comments

1. Before I run the Experiment 1 , should I run "create_data.ipynb" first?

2. This error occurred while I was running "create_data.ipynb" : Traceback (most recent call last): File "create_data.py", line 24, in <module> tk = tokenizer = get_tokenizer() File "create_data.py", line 22, in <lambda> get_tokenizer = lambda: RobertaTokenizer(config_dir='roberta.large') File "roberta.pyx", line 601, in roberta.RobertaTokenizer.__init__ File "roberta.pyx", line 229, in roberta.RobertaEncoder.__init__ File "roberta.pyx", line 183, in roberta.get_encoder FileNotFoundError: [Errno 2] No such file or directory: 'roberta.large/encoder.json'

So what is "encoder.json"

Thank you for your help !

zongshuai818 avatar Jan 04 '20 13:01 zongshuai818

I am encountering the same error. Have you solved it?

Winggi avatar Apr 04 '20 06:04 Winggi