llama.cpp
llama.cpp copied to clipboard
Bug: server crashes when embedding model is passed in the -m parameter
What happened?
We accidentally passed the embedding model (nomic-embed-text-v1.5) in the -m parameter, which caused the server to crash.
./llama-server -m /data/ollama-models/models/blobs/sha256-970aa74c0a90ef7482477cf803618e776e173c007bf957f635f1015bfcfef0e6 --path ./examples/server/public/
Name and Version
version: 3810 (1d48e98e) built with cc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-22) for x86_64-redhat-linux
What operating system are you seeing the problem on?
Linux
Relevant log output
llama_new_context_with_model: n_ctx = 8192
llama_new_context_with_model: n_batch = 2048
llama_new_context_with_model: n_ubatch = 512
llama_new_context_with_model: flash_attn = 0
llama_new_context_with_model: freq_base = 1000.0
llama_new_context_with_model: freq_scale = 1
llama_kv_cache_init: CPU KV buffer size = 288.00 MiB
llama_new_context_with_model: KV self size = 288.00 MiB, K (f16): 144.00 MiB, V (f16): 144.00 MiB
llama_new_context_with_model: CPU output buffer size = 0.23 MiB
src/llama.cpp:16813: GGML_ASSERT(strcmp(res->name, "result_output") == 0 && "missing result_output tensor") failed
llama_new_context_with_model: CPU compute buffer size = 22.00 MiB
llama_new_context_with_model: graph nodes = 450
llama_new_context_with_model: graph splits = 1
llama_init_from_gpt_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
No symbol table is loaded. Use the "file" command.
[New LWP 2617318]
[New LWP 2617319]
[New LWP 2617320]
[New LWP 2617321]
[New LWP 2617322]
[New LWP 2617323]
[New LWP 2617324]
[New LWP 2617325]
[New LWP 2617326]
[New LWP 2617327]
[New LWP 2617328]
[New LWP 2617329]
[New LWP 2617330]
[New LWP 2617331]
[New LWP 2617332]
[New LWP 2617333]
[New LWP 2617334]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
0x00007fb2483376a2 in waitpid () from /lib64/libpthread.so.0
No symbol "frame" in current context.
[Inferior 1 (process 2617317) detached]
Aborted (core dumped)