Iraklis Kourtis
Results
3
comments of
Iraklis Kourtis
Has anyone tested the output? Is it gibberish or meaningful?
> On machines with smaller memory and slower processors, it can be useful to reduce the overall number of threads running. For instance on my MacBook Pro Intel i5 16Gb...
I have 16Gb of memory. Here is my command: ``` ./main -m ./models/7B/ggml-model-q4_0.bin -p "[PROMPT]" -t 4 -n 512 ```