Bearsaerker
Bearsaerker
I'd love to see this as well!
Oh yeah duplicate, Im gonna close this then.
I'd LOVE to see that, I have the problem that i want to do this with my gym lifts, but i cant carry my laptop around and my webcam is...
I fiddled a little bit around and got it working myself. How can I commit this?
I'm in the editing mode of a chunk and I press my hotkey for copying block link and it does nothing. If I switch from lineage view to regular editing...
This is still a bug in version 0.6.0
Reranker support is merged, this should be now easy to implement and extremely important for RAG :) https://github.com/ggerganov/llama.cpp/pull/9510#issuecomment-2367526441
@dosu Did I misunderstand that the value of "max_length" is only related to the embed model max length but not to the sentence window max length? Because that would explain...
Unfortunately I really don't know how github works, but I implemented a solution for my Problem. I guess this would be a pull request? The size of the sentence window...
Unfortunately did not change a thing ./bin/llama-server -m '/home/luis/Downloads/llama.cpp-b4876/models/gemma-3-12b-it-Q5_K_M.gguf' --n-gpu-layers -1 --cache-type-k q8_0 --cache-type-v q8_0 --batch_size 1024 --flash-attn -c 4000 --port 7777 -t 8 -ngl 99 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init:...