alpaca.cpp
alpaca.cpp copied to clipboard
--interactive, --Interactive-start, and other launch options.
I was playing with several of these options, but they seem to do nothing, or I don't know how to use them. --interactive --Interactive-start --reverse-prompt PROMPT --prompt PROMPT --file FNAME
I was hoping to make it work in chat mode with some of these options, or to give it a fixed prompt that reads as context before giving a response, but nothing I tried seems to have any effect. If anyone knows how to use them, could you please explain it here, so it can be used as a reference? Thank you!!
Seems these options are broken, it become interactive by default, and ignore the prompt
ive found the new -f option doesn't seam to work and without a verbose option when loading the model i can not confirm whether or not it is working
command used
./chat -m ggml-alpaca-13b-q4.bin -t 39 --color -c 10400 -n 4096 --repeat_last_n 10400 -f cake
Yeah I don't think any of these launch options are doing anything
Yeah, --reverse-prompt is not doing anything for me either.
It would've been great to chat with something like Bob from llama.cpp with a customised personality.
-f seems to work in the sense that it reads the prompts written in the file, but it immediately ends the conversation after providing a single line of text with the '[end of text]' message. I'm not sure if I'm doing something wrong or not