fast-llama icon indicating copy to clipboard operation
fast-llama copied to clipboard

Published 20 hours ago • verified publisher icon CoderLSF

Llama 2 7b chat Q8 guff causes error unknown tokenid

Open arkadiuszbicz opened this issue 1 year ago • 1 comments

Llama 2 7b chat Q8 guff causes error unknown tokenid Commad ./main -c ./llama-2-7b-chat.Q8_o.gguf -j 40 -n 200-i "Advice "

Error

ERROR:[src/model_loaders/gguf_loader.cpp:320][load_gguf()]Unknown key:tokenizer.ggml.unknown_token_id Failed to load model

arkadiuszbicz avatar Dec 18 '23 10:12 arkadiuszbicz

+1

eliasgroll avatar Dec 27 '23 12:12 eliasgroll