sunyitao
sunyitao
request `curl -X POST http://172.25.96.1:8080/v1/files -F "file=@paris_chunks.txt"` error, but request `curl -X POST http://172.25.96.1:8080/v1/embeddings` is ok. Request `/v1/create/rag` is the same. [error:] ``` [2024-11-28 17:48:19.890] [info] rag_api_server in src/main.rs:497: endpoint:...
工具链调用之后,拿不到token usage信息,使用的dashscope的api。model直接绑定工具可以获取到usage,使用以下方式则不行。 ```go chain := compose.NewChain[[]*schema.Message, []*schema.Message]() chain. AppendChatModel(a.chatModel, compose.WithNodeName("chat_model")). AppendToolsNode(toolsNode, compose.WithNodeName("tools")) // compile chain agent, err := chain.Compile(ctx) ``` 从返回的报文中看到是有usage信息的: ``` data: {"choices":[],"object":"chat.completion.chunk","usage":{"prompt_tokens":5200,"completion_tokens":723,"total_tokens":5923,"prompt_tokens_details":{"cached_tokens":0}},"created":1751623871,"system_fingerprint":null,"model":"qwen-plus","id":"chatcmpl-e5038523-7846-96d2-b5bd-24ee5a961bbd"} ```