后续会规划做python语言的API调用方式吗？

[garvinzhang]

目前好像只能通过在控制台终端执行 ./main -m zh-models/7B/ggml-model-q4_0.bin --color -f prompts/alpaca.txt -ins -c 2048 --temp 0.2 -n 256 --repeat_penalty 1.3进入会话模式。

如果我想用python搭建一个服务，如何用python语言调用输入输出的接口模型呢？

[ymcui]

建议你参考其他llama API化的项目（github自行查找）。 我们的模型合并转换之后，原则上与原版llama没什么区别了（除了词表大小不一样）。

[honglvagan]

兄,你用的是 7b plus 吗?能不能..?

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

[github-actions[bot]]

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.