Alex Klinkhamer

icon indicating a website link grencez.dev

icon company @google icon location Mountain View, CA icon location Ask me anything about the computational complexities of synthesizing and verifying self-stabilizing protocols. Or whatever.

Results 2 issues of Alex Klinkhamer

examples : evaluate tokens in batches after swapping context

1 comment

This new loop around llama_eval is a bit redundant with the batching done in the main loop, but without a refactor it's all still necessary to keep print statements happening...

cmake : add install step for libllama and llama.h

This helps dependent CMake projects find the lib and header when they pull in llama.cpp with ExternalProject_Add().