Dane Madsen comments

Results 72 comments of


                                            Dane Madsen

Newer ggml files output gibberish due to outdated llama.cpp

ahh ok. LCPP is pretty far out of date so ive been working on getting it up to date

Newer ggml files output gibberish due to outdated llama.cpp

the patches ive applied is only in 1 file. Ive already "fixed" it so it compiles now but for some reason its crashing on macos

Newer ggml files output gibberish due to outdated llama.cpp

Its just the `update-lccp` branch of `maid_llm`. You can get the binary from actions https://github.com/Mobile-Artificial-Intelligence/maid/actions/runs/10571003934

Newer ggml files output gibberish due to outdated llama.cpp

It crashes on android too and presumably linux and windows too. MacOS binary was from the same actions commit: https://github.com/Mobile-Artificial-Intelligence/maid/actions/runs/10571003935 binaries are too big to upload here. You can try...

Newer ggml files output gibberish due to outdated llama.cpp

binary https://drive.google.com/file/d/1iq9sYSHgaFh39hf8jiZj-QWNTD4rTEF1/view?usp=sharing

Newer ggml files output gibberish due to outdated llama.cpp

hang on this is a babylon problem

Newer ggml files output gibberish due to outdated llama.cpp

yeah i fixed the babylon problem now its a different error

Newer ggml files output gibberish due to outdated llama.cpp

ok new dump ``` ------------------------------------- Translated Report (Full Report Below) ------------------------------------- Process: maid [48918] Path: /Users/USER/*/maid.app/Contents/MacOS/maid Identifier: com.danemadsen.maid Version: 1.3.1 (1850) Code Type: ARM-64 (Native) Parent Process: launchd [1] User...

Generation not working for specific models

Hmm OK, are you using the Llama class directly there or the LlamaProcessor? If its the former there might be an issue with the LlamaProcessor

Generation not working for specific models

Yeah i checked within maid and its still not giving a very good output. I might see if i can adapt your example for the processor to see whats up