llm icon indicating copy to clipboard operation
llm copied to clipboard

Published 20 hours ago • verified publisher icon rustformers

Update to latest upstream LLaMA implementation

Open philpax opened this issue 1 year ago • 1 comments

We're a couple weeks out of date with the current implementation of LLaMA in llama.cpp. There's quite a few changes (including always generating the BOS at the start!) that we should update to handle.

philpax avatar May 10 '23 22:05 philpax

There's also this that's happened:

https://github.com/ggerganov/llama.cpp/pull/1412

Which would help with GPU related issues I believe.

AshleySchaeffer avatar May 14 '23 07:05 AshleySchaeffer