tokenizer = T5Tokenizer.from_pretrained("t5-base"). Type of tokenizer object is NoneType

[sreeramk28]

When running the main function in CoLab, got the following error AttributeError: 'NoneType' object has no attribute 'batch_encode_plus' When I tried this, tokenizer = T5Tokenizer.from_pretrained("t5-base") print(type(tokenizer))

got, <class 'NoneType'>

[v-zmiycharov]

Install specific version of sentencepiece: pip install sentencepiece==0.1.91 https://github.com/huggingface/transformers/issues/9093#issuecomment-744260431

[VedantKP]

Even after installing the exact version of sentencepiece, it is still unable to load the t5-base model. tokenizer = T5Tokenizer.from_pretrained("t5-base") print(tokenizer) Gives output as "None"

[hotpeppeper]

restart notebook, install sentencepiece before tokenizer = T5Tokenizer.from_pretrained("t5-base")