alpaca.cpp icon indicating copy to clipboard operation
alpaca.cpp copied to clipboard

--interactive, --Interactive-start, and other launch options.

Open Pasajeromoronmoreno opened this issue 2 years ago • 5 comments

I was playing with several of these options, but they seem to do nothing, or I don't know how to use them. --interactive --Interactive-start --reverse-prompt PROMPT --prompt PROMPT --file FNAME

I was hoping to make it work in chat mode with some of these options, or to give it a fixed prompt that reads as context before giving a response, but nothing I tried seems to have any effect. If anyone knows how to use them, could you please explain it here, so it can be used as a reference? Thank you!!

Pasajeromoronmoreno avatar Mar 19 '23 14:03 Pasajeromoronmoreno

Seems these options are broken, it become interactive by default, and ignore the prompt

linonetwo avatar Mar 20 '23 16:03 linonetwo

ive found the new -f option doesn't seam to work and without a verbose option when loading the model i can not confirm whether or not it is working command used ./chat -m ggml-alpaca-13b-q4.bin -t 39 --color -c 10400 -n 4096 --repeat_last_n 10400 -f cake

Alexmakes avatar Mar 20 '23 18:03 Alexmakes

Yeah I don't think any of these launch options are doing anything

GrahamboJangles avatar Mar 21 '23 23:03 GrahamboJangles

Yeah, --reverse-prompt is not doing anything for me either. It would've been great to chat with something like Bob from llama.cpp with a customised personality.

vicfic18 avatar Mar 22 '23 02:03 vicfic18

-f seems to work in the sense that it reads the prompts written in the file, but it immediately ends the conversation after providing a single line of text with the '[end of text]' message. I'm not sure if I'm doing something wrong or not

Sidefix avatar Mar 23 '23 11:03 Sidefix