llama.cpp issues

Feature Request: RuntimeError: Unsloth: The file 'llama.cpp/llama-quantize' or 'llama.cpp/quantize' does not exist. But we expect this file to exist! Maybe the llama.cpp developers changed the name?

2

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...

San-Jain18

enhancement

stale

Request: support LlamaV-o1

This one looks promising.. https://huggingface.co/omkarthawakar/LlamaV-o1

0wwafa

stale

Feature Request: Support for iFlytek Spark 13B

2

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...

raulbalmez

enhancement

stale

WebUI - Mcp SSE server support in client

This is intended to be a discussion on adding MCP SSE Client support to the current WebUI. I have not started migrating the demo included into the WebUI, but the...

brucepro

examples

python

server

Compile bug: parameter packs not expanded with ‘...’:

7

### Git commit ecebbd292d741ac084cf248146b2cfb17002aa1d ### Operating systems Linux, Other? (Please let us know in description) ### GGML backends CUDA ### Problem description & steps to reproduce I'm trying to compile...

TheKoakuma

bug-unconfirmed

Refactor gguf scripts to improve metadata handling

2

I've had these changes locally for quite a while and more or less forgotten about them, it's high time to make a PR as it fixes a few issues (endianess...

CISC

python

gguf-py: handle numpy 2.0 byte-ordering changes

2

this commit fixes this error: ```python Traceback (most recent call last): File "/home/poweruser/python-goddamn-venv/bin/gguf-dump", line 8, in sys.exit(gguf_dump_entrypoint()) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/poweruser/python-goddamn-venv/lib/python3.12/site-packages/gguf/scripts/gguf_dump.py", line 450, in main dump_metadata(reader, args) File "/home/poweruser/python-goddamn-venv/lib/python3.12/site-packages/gguf/scripts/gguf_dump.py", line 35,...

parsapoorsh

python

tool-call: refactor common chat / tool-call api (+ tests / fixes)

Refactoring of chat / tool-call logic (follow up to https://github.com/ggml-org/llama.cpp/pull/11016) along the lines of @ggerganov's suggestions ([ref](https://github.com/ggml-org/llama.cpp/pull/11016#issuecomment-2660837676)): - Move all `common_chat_*` from `common.*` to `common/chat.*` - Moved minja headers to...

ochafik