Prashant Vithule

Hi, can you please share the information about generation of draft tokens, which method are you using. And after this how are you utilizing for creating Trie tree. It will...

This PR introduces support for SVE (Scalable Vector Extensions) kernels for the q3_K_q8_K vector dot on the Arm architecture. A similar proposal for SVE support is made in PR https://github.com/ggerganov/llama.cpp/pull/7433...