llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Bug: server crashes when embedding model is passed in the -m parameter

Open mesibo opened this issue 5 months ago • 0 comments

What happened?

We accidentally passed the embedding model (nomic-embed-text-v1.5) in the -m parameter, which caused the server to crash.

./llama-server -m /data/ollama-models/models/blobs/sha256-970aa74c0a90ef7482477cf803618e776e173c007bf957f635f1015bfcfef0e6 --path ./examples/server/public/

Name and Version

version: 3810 (1d48e98e) built with cc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-22) for x86_64-redhat-linux

What operating system are you seeing the problem on?

Linux

Relevant log output

llama_new_context_with_model: n_ctx      = 8192
llama_new_context_with_model: n_batch    = 2048
llama_new_context_with_model: n_ubatch   = 512
llama_new_context_with_model: flash_attn = 0
llama_new_context_with_model: freq_base  = 1000.0
llama_new_context_with_model: freq_scale = 1
llama_kv_cache_init:        CPU KV buffer size =   288.00 MiB
llama_new_context_with_model: KV self size  =  288.00 MiB, K (f16):  144.00 MiB, V (f16):  144.00 MiB
llama_new_context_with_model:        CPU  output buffer size =     0.23 MiB
src/llama.cpp:16813: GGML_ASSERT(strcmp(res->name, "result_output") == 0 && "missing result_output tensor") failed
llama_new_context_with_model:        CPU compute buffer size =    22.00 MiB
llama_new_context_with_model: graph nodes  = 450
llama_new_context_with_model: graph splits = 1
llama_init_from_gpt_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
No symbol table is loaded.  Use the "file" command.
[New LWP 2617318]
[New LWP 2617319]
[New LWP 2617320]
[New LWP 2617321]
[New LWP 2617322]
[New LWP 2617323]
[New LWP 2617324]
[New LWP 2617325]
[New LWP 2617326]
[New LWP 2617327]
[New LWP 2617328]
[New LWP 2617329]
[New LWP 2617330]
[New LWP 2617331]
[New LWP 2617332]
[New LWP 2617333]
[New LWP 2617334]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
0x00007fb2483376a2 in waitpid () from /lib64/libpthread.so.0
No symbol "frame" in current context.
[Inferior 1 (process 2617317) detached]
Aborted (core dumped)

mesibo avatar Sep 26 '24 09:09 mesibo