Misc. bug: llama-server web interface doesn't work in Firefox

[ppearson]

Name and Version

./llama-server --version version: 4607 (aa6fb132) built with Apple clang version 15.0.0 (clang-1500.1.0.2.5) for arm64-apple-darwin23.4.0

Operating systems

Mac

Which llama.cpp modules do you know to be affected?

llama-server

Command line

./llama-server -m /Users/$USER/ml/qwen/qwen2.5-coder-32b-instruct-q5_k_m.gguf -c 8192

Problem description & steps to reproduce

Using latest master on MacOS to run llama-server on localhost, the web interface doesn't seem to work in Firefox, but works in Safari and Chrome.

Firefox brings up a modal popup with:

127.0.0.1:8080

TypeError: conv.messages[0] is undefined.

and then after clearing that popup, another appears with:

TypeError: ResizeObserver.observe: Argument 1 is not an object.

After which there's just a blank page. I can't see anything else in the DevTools Console.

This is with Firefox 134 on MacOS, (M1 silicon), and as mentioned above, the web interface works fine with Safari and Chrome on the same machine.

First Bad Commit

No response

Relevant log output

[wbruna]

FWIW, on that same rev different Qwen models (I can't run a 32b) seem to work fine on 128.6.0esr here (Debian 12, amd64, KDE Wayland). Could you check if the same happens with the ESR version, or with other models?

[ppearson]

I've tried mixtral and llama models as well, same thing... They work fine in Chrome and Safari, not in Firefox...

Maybe it's MacOS-specific...

[ppearson]

I'm not really a JS dev, but from poking around in the Firefox dev tools debugger, it looks like conv.messages is an empty array:

[BVEsun]

I could chat with llama-server in firefox local chatbot, but can't do summarize, Explain this ... etc Version: b4743

[github-actions[bot]]

This issue was closed because it has been inactive for 14 days since being marked as stale.