alpaca.cpp icon indicating copy to clipboard operation
alpaca.cpp copied to clipboard

Strange characters in alpaca output

Open simondueckert opened this issue 2 years ago • 2 comments

I have installed alpaca.cpp according to a tutorial on medium.com (Windows Linux Subsystem on a Win 11 PC). Everything worked fine but when I enter a prompt I get only strange characters as results (see screenshot). What might be the problem?

llama-output

simondueckert avatar Mar 27 '23 09:03 simondueckert

I had a similar issue and it was due to the model not having been downloaded fully.

You can compare the hash of the model you have downloaded against the hashes shown in this pull request, if it doesn't match, it's likely that the download didn't work fully:

https://github.com/antimatter15/alpaca.cpp/pull/117/commits/9663ed33e0bfe5f64d5144e54688b6339f7a85d3

kajuberdut avatar Mar 28 '23 02:03 kajuberdut

Weird note on strange characters, many lines of generated dialog end with a space and some ascii symbols. I interrogated the model on what they were. In one case it said it was Chinese characters with some meaning, then translated them for me. In another set of characters it said that it was some form of smiling emoji.

Terristen avatar Mar 28 '23 19:03 Terristen