chatgpt-wechat
chatgpt-wechat copied to clipboard
Deepseek模型不能正常收到user prompt
作者你好,我使用企业微信客服,并且尝试接入火山方舟的deepseek-v3模型。但得到的回复总是雷同如下:
回复的内容只与system prompt有关,无论之后的user prompt如何变化,都只能得到类似的回复。
也尝试过clear,但是没有作用。 模型的API是正常的,同一时间用AnythingLLM调用相同的API工作正常。
附上控制台内容:
2025/04/07 17:22:14 /build/service/chat/api/internal/logic/customerchatlogic.go:57 record not found
[1.138ms] [rows:0] SELECT * FROM "chat" WHERE "chat"."message_id" = 'BHuSzjQuT4Gm1bj9eoAkdiL2yQ' AND "chat"."user" = 'wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ' ORDER BY "chat"."id" LIMIT 1
{"@timestamp":"2025-04-07T17:22:14.483+08:00","caller":"response/response.go:63","content":"","level":"info","response":{"code":200,"msg":"成功","data":{"message":"ok"}},"span":"18e6d7d138c0e712","trace":"e007e4367266cb50e9a3c2607567c46e"}
{"@timestamp":"2025-04-07T17:22:14.483+08:00","caller":"accesslog/accesslog.go:29","content":"","level":"info","request":{"url":"/api/msg/customer/push","method":"POST","query":"","body":"{\"msg_id\":\"BHuSzjQuT4Gm1bj9eoAkdiL2yQ\",\"msg\":\"#clear\",\"customer_id\":\"wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ\",\"open_kf_id\":\"wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q\"}","header":{"Accept-Encoding":["gzip"],"Authorization":["Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE3Njk5Mzc3MjgsImlhdCI6MTc0NDAxNzcyOCwidXNlcklkIjoxfQ.SgXDag1EA6EXxj2yiLq6qR_x3_uccBqFwBuz3gFTLU8"],"Content-Length":["151"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]},"const":2},"span":"18e6d7d138c0e712","trace":"e007e4367266cb50e9a3c2607567c46e"}
{"@timestamp":"2025-04-07T17:22:14.483+08:00","caller":"handler/loghandler.go:147","content":"[HTTP] 200 - POST /api/msg/customer/push - [::1]:46670 - Go-http-client/1.1","duration":"2.4ms","level":"info","span":"18e6d7d138c0e712","trace":"e007e4367266cb50e9a3c2607567c46e"}
incoming message: RxMessage { FromUserID: "", SendTime: 1744017745000000000, MsgType: "event", MsgID: 0, AgentID: 0, Event: "kf_msg_or_event", ChangeType: "", EventKey: "ENC5EUjykq1iNmePmWNqJStGeZEFXoGaLn41WkozaKb7hyh" }
客服消息 -------------------------------------
客服消息 Token: ENC5EUjykq1iNmePmWNqJStGeZEFXoGaLn41WkozaKb7hyh OpenKfID: wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q
客服消息 获取 message success. NextCursor: HHFq49uYHoiCuZRv9QAk
2025/04/07 17:22:25 /build/service/chat/api/internal/logic/customerchatlogic.go:57 record not found
[0.398ms] [rows:0] SELECT * FROM "chat" WHERE "chat"."message_id" = 'B77wuCmJgc8zsgfwDVFCVWAu2w' AND "chat"."user" = 'wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ' ORDER BY "chat"."id" LIMIT 1
上下文请求信息: collection.Prompt你是一个客户服务AI,你会回答我的问题。
[{ system {text/plain 你是一个客户服务AI,你会回答我的问题。}} {d1b1162b-1391-11f0-87e7-b69b86c3e532 user {text/plain 请问最小的自然数是几?}}]
{"@timestamp":"2025-04-07T17:22:25.771+08:00","caller":"response/response.go:63","content":"","level":"info","response":{"code":200,"msg":"成功","data":{"message":"ok"}},"span":"d4d9639a2df666a0","trace":"fc7bce851ab08c42219ad4af552e32b6"}
{"@timestamp":"2025-04-07T17:22:25.771+08:00","caller":"accesslog/accesslog.go:29","content":"","level":"info","request":{"url":"/api/msg/customer/push","method":"POST","query":"","body":"{\"msg_id\":\"B77wuCmJgc8zsgfwDVFCVWAu2w\",\"msg\":\"请问最小的自然数是几?\",\"customer_id\":\"wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ\",\"open_kf_id\":\"wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q\"}","header":{"Accept-Encoding":["gzip"],"Authorization":["Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE3Njk5Mzc3MjgsImlhdCI6MTc0NDAxNzcyOCwidXNlcklkIjoxfQ.SgXDag1EA6EXxj2yiLq6qR_x3_uccBqFwBuz3gFTLU8"],"Content-Length":["178"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]},"const":0},"span":"d4d9639a2df666a0","trace":"fc7bce851ab08c42219ad4af552e32b6"}
EncodingForModel: no encoding for model ep-20250219143041-6n4ql
EncodingForModel: no encoding for model ep-20250219143041-6n4ql
{"@timestamp":"2025-04-07T17:22:25.771+08:00","caller":"handler/loghandler.go:147","content":"[HTTP] 200 - POST /api/msg/customer/push - [::1]:40454 - Go-http-client/1.1","duration":"1.0ms","level":"info","span":"d4d9639a2df666a0","trace":"fc7bce851ab08c42219ad4af552e32b6"}
2025/04/07 17:22:25 /build/service/chat/api/internal/logic/customerchatlogic.go:324
[27.763ms] [rows:1] INSERT INTO "chat" ("user","message_id","open_kf_id","agent_id","req_content","res_content") VALUES ('wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ','B77wuCmJgc8zsgfwDVFCVWAu2w','wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q',0,'请问最小的自然数是几?','') RETURNING "id","created_at","updated_at"
{"@timestamp":"2025-04-07T17:23:04.748+08:00","caller":"proc/shutdown.go:84","content":"Got signal 15, shutting down...","level":"info"}
可以看到user prompt至少是正常传递到了容器这一级的。
我注意到有两处不寻常,请问是否和这个也有关呢? EncodingForModel: no encoding for model ep-20250219143041-6n4ql EncodingForModel: no encoding for model ep-20250219143041-6n4ql
非常感谢您!
和这个没有关系,我改了一下
新加入了 debug 参数,你开启之后,再看看呢?
我clone了您更新的这一版并且打开了debug重新试了一下。反应基本一样。
incoming message: RxMessage { FromUserID: "", SendTime: 1744079795000000000, MsgType: "event", MsgID: 0, AgentID: 0, Event: "kf_msg_or_event", ChangeType: "", EventKey: "ENC6fjqHRN5mn3ykNKvgUygv8oYFVycQAApUQ4BshDUt1ip" }
客服消息 -------------------------------------
客服消息 Token: ENC6fjqHRN5mn3ykNKvgUygv8oYFVycQAApUQ4BshDUt1ip OpenKfID: wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q
客服消息 获取 message success. NextCursor: HHFq49uYHoiCuZRv9SqE
2025/04/08 10:36:36 /build/service/chat/api/internal/logic/customerchatlogic.go:57 record not found
[0.302ms] [rows:0] SELECT * FROM "chat" WHERE "chat"."message_id" = 'AvdLmss3FcYm57u7Xsuy7RRPmb' AND "chat"."user" = 'wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ' ORDER BY "chat"."id" LIMIT 1
上下文请求信息: collection.Prompt 你是 DeepSeek, 一个由深度求索公司(DeepSeek)创造的智能AI助手!, 你旨在回答并解决人们的任何问题,并且可以使用多种语言与人交流。
[{ system {text/plain 你是 DeepSeek, 一个由深度求索公司(DeepSeek)创造的智能AI助手!, 你旨在回答并解决人们的任何问题,并且可以使用多种语言与人交流。}} {4a8d738f-1422-11f0-861b-aeca9152fb43 user {text/plain 最小的自然数是几?}}]
{"@timestamp":"2025-04-08T10:36:36.071+08:00","caller":"response/response.go:63","content":"","level":"info","response":{"code":200,"msg":"成功","data":{"message":"ok"}},"span":"7ab9228363c6310c","trace":"a006a2444f95925af2d2641930808735"}
{"@timestamp":"2025-04-08T10:36:36.071+08:00","caller":"accesslog/accesslog.go:29","content":"","level":"info","request":{"url":"/api/msg/customer/push","method":"POST","query":"","body":"{\"msg_id\":\"AvdLmss3FcYm57u7Xsuy7RRPmb\",\"msg\":\"最小的自然数是几?\",\"customer_id\":\"wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ\",\"open_kf_id\":\"wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q\"}","header":{"Accept-Encoding":["gzip"],"Authorization":["Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE3Njk5OTk1MTMsImlhdCI6MTc0NDA3OTUxMywidXNlcklkIjoxfQ.sHMQYL6WSweftZHZvBMBdoO0S81UbHKYY1GhPqtB1Vw"],"Content-Length":["172"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]},"const":0},"span":"7ab9228363c6310c","trace":"a006a2444f95925af2d2641930808735"}
{"@timestamp":"2025-04-08T10:36:36.071+08:00","caller":"handler/loghandler.go:147","content":"[HTTP] 200 - POST /api/msg/customer/push - [::1]:47962 - Go-http-client/1.1","duration":"0.8ms","level":"info","span":"7ab9228363c6310c","trace":"a006a2444f95925af2d2641930808735"}
request body: {"messages":[{"content":"你是 DeepSeek, 一个由深度求索公司(DeepSeek)创造的智能AI助手!, 你旨在回答并解决人们的任何问题,并且可以使用多种语言与人交流。","role":"system"}],"model":"ep-20250219143041-6n4ql","stream":true,"temperature":1}
Full response: 你好!我是DeepSeek,由深度求索公司创造的AI助手。我可以帮助你解答各种问题,无论是学习、工作还是日常生活中的疑问,我都会尽力提供准确、有用的信息。如果你有任何需要,随时告诉我!😊
你今天想了解些什么呢?
2025/04/08 10:36:39 /build/service/chat/api/internal/logic/customerchatlogic.go:325
[32.841ms] [rows:1] INSERT INTO "chat" ("user","message_id","open_kf_id","agent_id","req_content","res_content") VALUES ('wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ','AvdLmss3FcYm57u7Xsuy7RRPmb','wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q',0,'最小的自然数是几?','你好!我是DeepSeek,由深度求索公司创造的AI助手。我可以帮助你解答各种问题,无论是学习、工作还是日常生活中的疑问,我都会尽力提供准确、有用的信息。如果你有任何需要,随时告诉我!😊
你今天想了解些什么呢?') RETURNING "id","created_at","updated_at"
incoming message: RxMessage { FromUserID: "", SendTime: 1744079804000000000, MsgType: "event", MsgID: 0, AgentID: 0, Event: "kf_msg_or_event", ChangeType: "", EventKey: "ENC8ySf97vazwenCvPAJymtMct3y9RqH2pxnpJYNrQUXaYs" }
客服消息 -------------------------------------
客服消息 Token: ENC8ySf97vazwenCvPAJymtMct3y9RqH2pxnpJYNrQUXaYs OpenKfID: wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q
客服消息 获取 message success. NextCursor: HHFq49uYHoiCuZRv9T4U
2025/04/08 10:36:45 /build/service/chat/api/internal/logic/customerchatlogic.go:57 record not found
[0.407ms] [rows:0] SELECT * FROM "chat" WHERE "chat"."message_id" = 'ANu2wVkDF5cNTTTeEBSKtd94Bd' AND "chat"."user" = 'wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ' ORDER BY "chat"."id" LIMIT 1
上下文请求信息: collection.Prompt 你是 DeepSeek, 一个由深度求索公司(DeepSeek)创造的智能AI助手!, 你旨在回答并解决人们的任何问题,并且可以使用多种语言与人交流。
[{ system {text/plain 你是 DeepSeek, 一个由深度求索公司(DeepSeek)创造的智能AI助手!, 你旨在回答并解决人们的任何问题,并且可以使用多种语言与人交流。}} {4a8d738f-1422-11f0-861b-aeca9152fb43 user {text/plain 最小的自然数是几?}} {4a8d738f-1422-11f0-861b-aeca9152fb43 assistant {text/plain 你好!我是DeepSeek,由深度求索公司创造的AI助手。我可以帮助你解答各种问题,无论是学习、工作还是日常生活中的疑问,我都会尽力提供准确、有用的信息。如果你有任何需要,随时告诉我!😊
你今天想了解些什么呢?}} {500377b7-1422-11f0-861b-aeca9152fb43 user {text/plain 一个周有几天?}}]
{"@timestamp":"2025-04-08T10:36:45.233+08:00","caller":"response/response.go:63","content":"","level":"info","response":{"code":200,"msg":"成功","data":{"message":"ok"}},"span":"9d1f055821e1aa4d","trace":"3b28d740664b4d9083b6eaad0dd9e1c5"}
{"@timestamp":"2025-04-08T10:36:45.233+08:00","caller":"accesslog/accesslog.go:29","content":"","level":"info","request":{"url":"/api/msg/customer/push","method":"POST","query":"","body":"{\"msg_id\":\"ANu2wVkDF5cNTTTeEBSKtd94Bd\",\"msg\":\"一个周有几天?\",\"customer_id\":\"wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ\",\"open_kf_id\":\"wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q\"}","header":{"Accept-Encoding":["gzip"],"Authorization":["Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE3Njk5OTk1MTMsImlhdCI6MTc0NDA3OTUxMywidXNlcklkIjoxfQ.sHMQYL6WSweftZHZvBMBdoO0S81UbHKYY1GhPqtB1Vw"],"Content-Length":["166"],"Content-Type":["application/json"],"User-Agent":["Go-http-client/1.1"]},"const":0},"span":"9d1f055821e1aa4d","trace":"3b28d740664b4d9083b6eaad0dd9e1c5"}
{"@timestamp":"2025-04-08T10:36:45.233+08:00","caller":"handler/loghandler.go:147","content":"[HTTP] 200 - POST /api/msg/customer/push - [::1]:34202 - Go-http-client/1.1","duration":"0.9ms","level":"info","span":"9d1f055821e1aa4d","trace":"3b28d740664b4d9083b6eaad0dd9e1c5"}
request body: {"messages":[{"content":"你是 DeepSeek, 一个由深度求索公司(DeepSeek)创造的智能AI助手!, 你旨在回答并解决人们的任何问题,并且可以使用多种语言与人交流。","role":"system"}],"model":"ep-20250219143041-6n4ql","stream":true,"temperature":1}
Full response: 你好!我是DeepSeek,很高兴见到你!😊 我可以帮助你解答各种问题,无论是学习、工作,还是日常生活中的疑问,都可以随时向我提问。有什么我可以帮你的吗?
2025/04/08 10:36:47 /build/service/chat/api/internal/logic/customerchatlogic.go:325
[34.380ms] [rows:1] INSERT INTO "chat" ("user","message_id","open_kf_id","agent_id","req_content","res_content") VALUES ('wmMwALCgAAHjbgafui7I7yDwXvhfIjdQ','ANu2wVkDF5cNTTTeEBSKtd94Bd','wkMwALCgAAAjSLL-4SV_o0GThxd52c_Q',0,'一个周有几天?','你好!我是DeepSeek,很高兴见到你!😊 我可以帮助你解答各种问题,无论是学习、工作,还是日常生活中的疑问,都可以随时向我提问。有什么我可以帮你的吗?') RETURNING "id","created_at","updated_at"
此外,还发现有一些指令也会被识别成prompt。
request body: {"messages":[{"content":"你是 DeepSeek, 一个由深度求索公司(DeepSeek)创造的智能AI助手!, 你旨在回答并解决人们的任何问题,并且可以使用多种语言与人交流。","role":"system"}],"model":"ep-20250219143041-6n4ql","stream":true,"temperature":1}
我看到了这个信息,感觉 是上下文没有被正确的加载进去,另外我有一点好奇
理论上我目前的 host 是不支持 火山引擎的路由的,因为默认是 v1 版本 ,你能给我看下你的配置吗?注意打码
指令这一块, 在客服这边是用处不大的,好多我没加入进来
åºè¯¥ä¸æ¯éè¿æ¨æ¾å°çè¿ä¸ªapiæ¥å ¥çãèæ¯éè¿ä¸OpenAIå ¼å®¹çæ¹å¼æ¥å ¥çï¼è¿æ¯ç«å±±å¼æç»åºçè°ç¨ç¤ºä¾ã
https://www.volcengine.com/docs/82379/1399008
import os
from openai import OpenAI
# è¯·ç¡®ä¿æ¨å·²å° API Key åå¨å¨ç¯å¢åé ARK_API_KEY ä¸
# åå§åOpenai客æ·ç«¯ï¼ä»ç¯å¢åéä¸è¯»åæ¨çAPI Key
client = OpenAI(
# æ¤ä¸ºé»è®¤è·¯å¾ï¼æ¨å¯æ ¹æ®ä¸å¡æå¨å°åè¿è¡é
ç½®
base_url="https://ark.cn-beijing.volces.com/api/v3",
# ä»ç¯å¢åéä¸è·åæ¨ç API Key
api_key=os.environ.get("ARK_API_KEY"),
)
# Non-streaming:
print("----- standard request -----")
completion = client.chat.completions.create(
# æå®æ¨åå»ºçæ¹èæ¨çæ¥å
¥ç¹ IDï¼æ¤å¤å·²å¸®æ¨ä¿®æ¹ä¸ºæ¨çæ¨çæ¥å
¥ç¹ ID
model="ep-20250219143041-6n4ql",
messages=[
{"role": "system", "content": "ä½ æ¯äººå·¥æºè½å©æ"},
{"role": "user", "content": "常è§çååè±ç§æ¤ç©æåªäºï¼"},
],
)
print(completion.choices[0].message.content)
# Streaming:
print("----- streaming request -----")
stream = client.chat.completions.create(
# æå®æ¨åå»ºçæ¹èæ¨çæ¥å
¥ç¹ IDï¼æ¤å¤å·²å¸®æ¨ä¿®æ¹ä¸ºæ¨çæ¨çæ¥å
¥ç¹ ID
model="ep-20250219143041-6n4ql",
messages=[
{"role": "system", "content": "ä½ æ¯äººå·¥æºè½å©æ"},
{"role": "user", "content": "常è§çååè±ç§æ¤ç©æåªäºï¼"},
],
# ååºå
容æ¯å¦æµå¼è¿å
stream=True,
)
for chunk in stream:
if not chunk.choices:
continue
print(chunk.choices[0].delta.content, end="")
print()
使¨æªå¾ç»åºçAPIæä¹æå°è¯è¿ï¼ç´æ¥æ æ³è¿æ¥å°æ¨¡åãç°å¨è¿ä¸ªè³å°è¿å¯ä»¥è¿æ¥å°æ¨¡åã
é ç½®æä»¶ï¼
Name: chat-api # 项ç®åç§°
Host: 0.0.0.0 # 项ç®çå¬å°å
Port: 8888 # 项ç®çå¬ç«¯å£
#Mysql:
# DataSource: chat:Chat-gpt~wechat@tcp(mysql81:3306)/chat?charset=utf8mb4&parseTime=true&loc=Asia%2FShanghai # æ°æ®åºè¿æ¥å°å
PGSql:
DataSource: "host=pgvector user=chat password=Chat-gpt~wechat dbname=chat port=5432 sslmode=disable TimeZone=Asia/Shanghai"
RedisCache:
- Host: [***] # redisç¼åå°å
Pass: "[***]" # redisç¼åå¯ç
WeCom: # ä¼ä¸å¾®ä¿¡é
ç½®
Port: 8887 # ä¼ä¸å¾®ä¿¡åè°çå¬ç«¯å£ï¼å¯éï¼é»è®¤ä¸º8887
CorpID: "[***]" # ä¼ä¸å¾®ä¿¡ CorpID
Token: "[***]" # ä¼ä¸å¾®ä¿¡åºç¨/å®¢ææ¶æ¯ Token
EncodingAESKey: "[***]" # ä¼ä¸å¾®ä¿¡åºç¨/å®¢ææ¶æ¯ EncodingAESKey
MultipleApplication: # å¤åºç¨é
ç½®
- AgentID: [***] # ä¼ä¸å¾®ä¿¡åºç¨ID
AgentSecret: "[***]" # ä¼ä¸å¾®ä¿¡åºç¨ Secret
ManageAllKFSession: true # manage_all_kf_session 为 true æ¶ï¼ç®¡çææå®¢æä¼è¯
Model: "ep-20250219143041-6n4ql" # openai 模åï¼å¯éï¼é»è®¤ä¸º gpt-3.5-turbo å¯é[gpt-3.5-turbo-16k, gpt-4,gpt-4-32k]
BasePrompt: "ä½ æ¯ ChatGPTï¼ ä¸ä¸ªç± OpenAI è®ç»ç大åè¯è¨æ¨¡åï¼ä½ æ¨å¨åçå¹¶è§£å³äººä»¬çä»»ä½é®é¢ï¼å¹¶ä¸å¯ä»¥ä½¿ç¨å¤ç§è¯è¨ä¸äººäº¤æµã" # openai åºç¡è®¾å®ï¼å¯éï¼
Welcome: "æ¨å¥½ï¼ææ¯ ChatGPTï¼ä¸ä¸ªç± OpenAI è®ç»ç大åè¯è¨æ¨¡åï¼æå¯ä»¥åçæ¨çé®é¢åè¿è¡äº¤æµã请åè¯ææ¨éè¦äºè§£äºä»ä¹ï¼æä¼å°½åä¸ºæ¨æä¾çæ¡ãåé#help >æ¥çæ´å¤åè½" # è¿å
¥åºç¨æ¶ç欢è¿è¯
ModelProvider: # æå¡æä¾è
å¯éæ© openai / gemini / dify / deepseek é»è®¤ä¸º openai
Company: "deepseek" # openai / gemini / dify / deepseek
[ç¥å»å
¶ä»æ¨¡å]
DeepSeek:
Key: "[***]" # deepseek key
Host: "https://ark.cn-beijing.volces.com/api/v3" # deepseek host (å¯é)
Model: "ep-20250219143041-6n4ql" # deepseek model (å¯é) é»è®¤ä¸º deepseek-chat deepseek-chat/deepseek-reasoner
Prompt: "ä½ æ¯ DeepSeek, ä¸ä¸ªç±æ·±åº¦æ±ç´¢å
¬å¸ï¼DeepSeekï¼åé çæºè½AI婿ï¼, ä½ æ¨å¨åçå¹¶è§£å³äººä»¬çä»»ä½é®é¢ï¼å¹¶ä¸å¯ä»¥ä½¿ç¨å¤ç§è¯è¨ä¸äººäº¤æµã" # deepseek prompt (å¯é)
Temperature: 1.0 # 对è¯çåé æ§ï¼å½å
¶é¼è¿ä¸0æ¶ï¼å
¶ååºçç»ææ´å æ»æ¿ï¼å½å
¶è¶è¿äº2æ¶ï¼å
¶å¯¹è¯æ´å 符æè·³è·ä¸åé å
EnableProxy: false #ï¼å¯éï¼æ¯å¦å¼å¯ä»£çï¼é»è®¤ä¸º false
Debug: true #ï¼å¯éï¼æ¯å¦å¼å¯è°è¯ï¼é»è®¤ä¸º false
Response: # åå¤é
ç½®
Stream: true # æ¯å¦å¼å¯æµå¼åå¤,èªå¨æå¥ï¼å¯éï¼
我找到原因了,应该是 ep-20250219143041-6n4ql 这个模型名称我不知道算 reason 还是 chat 导致的,目前先加了一个补丁,能正常输出了,reason 模型 暂时先不支持,我还要多加参数兼容这种第三方的情况