llm icon indicating copy to clipboard operation
llm copied to clipboard

Support the bit-shuffling changes from `llama.cpp`

Open philpax opened this issue 2 years ago • 1 comments

A new file version is being introduced to change how the tensors are stored on-disk: https://github.com/ggerganov/llama.cpp/pull/1305

We will need to support this version, as well as the older versions.

philpax avatar May 09 '23 16:05 philpax

It's been merged: https://github.com/ggerganov/llama.cpp/pull/1405

There doesn't seem to be a migration path at present, so let's wait a bit: https://github.com/ggerganov/llama.cpp/issues/1408

philpax avatar May 13 '23 19:05 philpax

This is done in #226, but I'd like to set up a migration path before I close this

philpax avatar May 16 '23 19:05 philpax

No migration path for now. See #261

philpax avatar May 22 '23 03:05 philpax