HSLUCKY

### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar feature requirement. ### Description 【1】希望能够使用外挂向量库方便多系统共享库，并且通过cs模式网络连接chroma 【2】系统能够使用VisualGLM-6B之类的多模态大模型 ### Use case 【1】希望能够使用外挂向量库方便多系统共享库，并且通过cs模式网络连接chroma 【2】系统能够使用VisualGLM-6B之类的多模态大模型 ### Related issues...

### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar feature requirement. ### Description 希望集成AutoGen到项目里，这将大大提高模型的可用性 ### Use case 智能弹幕 ### Related issues _No response_...

### Search before asking - [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues. ### Operating system information Windows ### Python version information 3.10 ### DB-GPT version...

How can we leverage the GPU for inference formatting?

6

### Describe the issue as clearly as possible: When utilizing the Outliens VLLM mode for JSON and regex inference, the GPU utilization remains at 0%, while the CPU utilization peaks...