alpaca.cpp
alpaca.cpp copied to clipboard
antimatter15
Locally run an Instruction-Tuned Chat-Style LLM
How to change/allow other languages, I write in Russian, but the AI does not understand what I am writing and answers the wrong topic. (I use Windows) Here I wrote...
but ive noticed no mater what *.bin i use sometimes it will repeat the last sentence a good bit till i hit control+c, is this a glitch or is it...
`leafy@raspberrypi:~/alpaca.cpp $ ./chat` `main: seed = 1681116282` `llama_model_load: loading model from 'ggml-alpaca-7b-q4.bin' - please wait ...` `llama_model_load: ggml ctx size = 6065.34 MB` `Segmentation fault` Tried to run the 7b...
When you try to chat with these on not english language, the answer will hallucinate and on english, but if you use file as prompt, everything works fine(picrelated). This is...
Since all changes are now upstreamed, people are accidentally using this instead of the up to date version. It's probably best to either move the warning to the top or...
Hi there, thanks for the great library!! :bow: Motivated by a pretty specific application (to get alpaca results "verifiable" by running on Cartesi which is ontop of blockchain), I'm trying...
What we need is a local cpp for llm "HuggingFaceH4/starchat-alpha A". It is much better than any other open source chat models at coding. And it does very well at...
Hi, so I downloaded the bin file on my MacBook Pro M1, put it into the same folder as Mac release, but got this error. Would you know what to...
Metadata
Owner
Metadata
Locally run an Instruction-Tuned Chat-Style LLM