ggllm.cpp
ggllm.cpp copied to clipboard
Does the prompt cache work? I got an alignment assert when I turned it on.
Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [Y ] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [Y ] I carefully followed the README.md.
- [Y ] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- [Y ] I reviewed the Discussions, and have a new bug or useful enhancement to share.