assistant Oops! Response Exception问题

[jingnorth]

assistant Oops! Response Exception

试了llama3-70b,上述这个回答是否是资源不够的问题，下面是ollama的日志

May 10 21:19:13 wae ollama[14972]: {"function":"process_single_task","level":"INFO","line":1507,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":97,"tid":"140514672760704","times tamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"log_server_request","level":"INFO","line":2735,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":57 168,"status":200,"tid":"140473610786560","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"log_server_request","level":"INFO","line":2735,"method":"POST","msg":"request","params":{},"path":"/tokenize","remote_addr":"127.0.0.1","remote_port" :57168,"status":200,"tid":"140473610786560","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"process_single_task","level":"INFO","line":1507,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":98,"tid":"140514672760704","times tamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"log_server_request","level":"INFO","line":2735,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":57 170,"status":200,"tid":"140473619179264","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"launch_slot_with_data","level":"INFO","line":830,"msg":"slot is processing task","slot_id":0,"task_id":99,"tid":"140514672760704","timestamp":1715347 153} May 10 21:19:13 wae ollama[14972]: {"function":"update_slots","ga_i":0,"level":"INFO","line":1810,"msg":"slot progression","n_past":647,"n_past_se":0,"n_prompt_tokens_processed":719,"slot_id":0,"ta sk_id":99,"tid":"140514672760704","timestamp":1715347153} May 10 21:19:13 wae ollama[14972]: {"function":"update_slots","level":"INFO","line":1837,"msg":"kv cache rm [p0, end)","p0":647,"slot_id":0,"task_id":99,"tid":"140514672760704","timestamp":17153471 53} May 10 21:24:14 wae ollama[14972]: [GIN] 2024/05/10 - 21:24:14 | 200 | 5m1s | 172.20.0.4 | POST "/api/chat"