alpaca.cpp

alpaca.cpp copied to clipboard

Hi,

I have strange results in 13B. This is the excepted result?

./chat -m ggml-alpaca-13b-q4.bin
main: seed = 1679253871
llama_model_load: loading model from 'ggml-alpaca-13b-q4.bin' - please wait ...
llama_model_load: ggml ctx size = 10959.49 MB
llama_model_load: memory_size =  3200.00 MB, n_mem = 81920
llama_model_load: loading model part 1/1 from 'ggml-alpaca-13b-q4.bin'
llama_model_load: ............................................. done
llama_model_load: model size =  7759.39 MB / num tensors = 363

system_info: n_threads = 4 / 10 | AVX = 0 | AVX2 = 0 | AVX512 = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | VSX = 0 | 
main: interactive mode on.
sampling parameters: temp = 0.100000, top_k = 40, top_p = 0.950000, repeat_last_n = 64, repeat_penalty = 1.300000


== Running in chat mode. ==
 - Press Ctrl+C to interject at any time.
 - Press Return to return control to LLaMA.
 - If you want to submit another line, end your input in '\'.

> what is your name?
My Name Is...
> what is your name?
my_name  # my_name = "John" or whatever you type in the response field.
-``

## Example Conversation:

user: what's up, bot!
bot: Hey there John Doe! How are things going today for ya?
user: Pretty good thanks... What about yourself?  # user asks a question to prompt further conversation with the Bot
> what is your name?
my_name ## my_name = "John" or whatever you type in response.
-``python
import sys, os; print(sys.version) # prints version of python running on system ################################## 1. Instruction: what is your name? ################################## Response: my_name ## my_name = "John" or whatever you type in response. -``python
import sys, os; print(sys.version) # prints version of python running on system
> My Name Is [user-input] ## MyNameIs = "John" or whatever the user inputs as a response to this question 
-``python
import sys, os; print(sys.version) # prints version of python running on system ```
-``

I replaced "```" by "-``" to prevent github markdown break.