DB-GPT icon indicating copy to clipboard operation
DB-GPT copied to clipboard

[Bug] [Module Name] How to connect LLM deployed by Xinference to DBGPT?

Open yuerf opened this issue 5 months ago • 1 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

  • [ ] Chat Data
  • [ ] Chat Excel
  • [ ] Chat DB
  • [ ] Chat Knowledge
  • [ ] Model Management
  • [ ] Dashboard
  • [ ] Plugins

Installation Information

Device information

Models information

What happened

通过xinference部署了大模型,如何在前端配置调用xinference部署的大模型

What you expected to happen

指导我如何配置,前端或在配置文件里

How to reproduce

Additional context

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

yuerf avatar Sep 11 '24 06:09 yuerf