ccly1996

能接入vicuna模型吗

2

目前本地已经有了vicuna模型能直接接入吗？

你好，能说一下具体的调用过程吗，我跑的时候出了一个错

[Bug] [proxyllm]An error occurs when I use the locally deployed OpenAI interface

6

### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues. ### Operating system information Linux ### Python version information 3.9 ### DB-GPT version...

### Describe the bug 我用fastGPT接入了xinference部署的vllm qwen32b，测试并发的时候会遇到跑4个并发的时候xinference后台报错，然后ui里也看不到跑的模型了，显卡还在100%占用 ### To Reproduce To help us to reproduce this bug, please provide information below: 1. Your Python version.3.10 2. The version of xinference you...

perf流式输出报错

5

加上--stream参数流式输出测试是会报错  非流式输出无问题