llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Api llama_tokenize function problem

Open Eriter555 opened this issue 4 months ago • 0 comments

In the llama_tokenize function, the add_special parameter does not affect the resulting array of tokens (as I understand it, a bos token should be added to the beginning). Model Meta-Llama-3-8B.Q5_K_M.gguf , for example. processor with AVX2

Eriter555 avatar Apr 23 '24 19:04 Eriter555