honeybee
honeybee copied to clipboard
add sentencepiece to pip requirements
sentencepiece is needed when from pipeline.interface import get_model; model, tokenizer, processor = get_model(ckpt_path, use_bf16=True)
.
I added sentencepiece
to pip requirements for LlamaTokenizer.