Chting

It's strange to return after executing the command

4

./main -m ./models/7B/ggml-model-q4_0.bin -t 64 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -p 'What is your name?'  Is it because I haven't installed something？ Centos 7

Error build on centos 7

2

   Intel(R) Xeon(R) Platinum 8369B CPU @ 2.90GHz Where is the problem? What should I do?

How should I use multiple GPUs？

8

I'm testing 65B. One A100 is too slow. I want to use two or four

支持3.5turbo的插件不支持人格设置了吗？

6

总是回答：作为AI语言模型，没有真正的身份和个性