llama.cpp
llama.cpp copied to clipboard
Api llama_tokenize function problem
In the llama_tokenize function, the add_special parameter does not affect the resulting array of tokens (as I understand it, a bos token should be added to the beginning). Model Meta-Llama-3-8B.Q5_K_M.gguf , for example. processor with AVX2