模型的回答是空输出，偶尔能输出一次正常的；后面我将语言切换到中文后，最初对话顺序错乱后面就都正常；

[WenJieLife]

1.启动命令和操作系统信息： ./ai00_server --model ~/GPT/RWKV-model/RWKV-4-World-CHNtuned-7B-v1-20230709-ctx4096.st --quant 32 系统：Ubuntu22 显卡：AMD RX6700XT 12GB

2.以下是终端记录： `terryjay@TJUbuntu:~/GPT/ai00$ ./ai00_server --model ./RWKV-4-World-CHNtuned-7B-v1-20230709-ctx4096.st --quant 32 ✔ Please select an adapter · AMD Radeon RX 6700 XT (RADV NAVI22) (Vulkan) 2023-09-16T03:12:15.772Z INFO [ai00_server] server started at http://0.0.0.0:65530 2023-09-16T03:14:59.251Z INFO [ai00_server] AdapterInfo { name: "AMD Radeon RX 6700 XT (RADV NAVI22)", vendor: 4098, device: 29663, device_type: DiscreteGpu, driver: "radv", driver_info: "Mesa 22.2.5-0ubuntu0.1~22.04.3", backend: Vulkan, } 2023-09-16T03:14:59.251Z INFO [ai00_server] ModelInfo { num_layers: 32, num_emb: 4096, num_vocab: 65536, } 2023-09-16T03:14:59.251Z INFO [ai00_server] chosen head chunk size: large (8192) 2023-09-16T03:17:08.866Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:08.866Z TRACE [ai00_server] state cache miss 2023-09-16T03:17:08.866Z TRACE [ai00_server] User: 现在的时间是2023 9月 16日 星期六 上午

Assistant: 好的我知道了！

User: 你是谁？

Assistant: Hello, I am your AI assistant. If you have any questions or instructions, please let me know!

User: 你好

Assistant:

User: hello

Assistant:

User: 你好

Assistant:

[DONE] 2023-09-16T03:17:09.823Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:29.249Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:29.249Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:29.249Z TRACE [ai00_server] User: hello!

Assistant: User:[DONE] 2023-09-16T03:17:29.405Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:33.687Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:33.688Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:33.688Z TRACE [ai00_server]

User: 111

Assistant: User

[DONE] 2023-09-16T03:17:33.853Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:37.943Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:37.943Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:37.943Z TRACE [ai00_server] User: ???

Assistant: I'm sorry, but I'm not sure what you mean by "111". Can you please provide more context or information?

[DONE] 2023-09-16T03:17:39.044Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:52.410Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:52.410Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:52.410Z TRACE [ai00_server] User: 今天是什么日子

Assistant: User:[DONE] 2023-09-16T03:17:52.618Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:27:47.835Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:27:47.835Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:27:47.836Z TRACE [ai00_server]

User: 你叫什么

Assistant: User

[DONE] 2023-09-16T03:27:48.017Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:27:54.082Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:27:54.082Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:27:54.082Z TRACE [ai00_server] User: ？

Assistant: 我是一个AI助手，你可以称呼我为“你”或者“小助手”。

[DONE] 2023-09-16T03:27:55.263Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:27:59.982Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:27:59.982Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:27:59.982Z TRACE [ai00_server] User: 111

Assistant: 好的，有什么问题或任务需要我帮忙吗？

[DONE] 2023-09-16T03:28:00.806Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:28:06.045Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:28:06.045Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:28:06.045Z TRACE [ai00_server] User: OK

Assistant: 如果您有任何问题或需要帮助，请随时告诉我。

[DONE] 2023-09-16T03:28:07.027Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:28:13.035Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:28:13.036Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:28:13.036Z TRACE [ai00_server] User: 小助手

Assistant: 是的，有什么我可以帮您的吗？User:[DONE] 2023-09-16T03:28:13.867Z TRACE [ai00_server] state cache evicted: 0 `

3.以下是网页chat截图：