honeybee
honeybee copied to clipboard
add sentencepiece to pip requirements
sentencepiece is needed when from pipeline.interface import get_model; model, tokenizer, processor = get_model(ckpt_path, use_bf16=True).
I added sentencepiece to pip requirements for LlamaTokenizer.