[Bug] [Docker Compose] failed to deploy on a server with no GPU

[maxpaynebupt]

Search before asking

• [X] I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

• [ ] Chat Data
• [ ] Chat Excel
• [ ] Chat DB
• [ ] Chat Knowledge
• [ ] Model Management
• [ ] Dashboard
• [ ] Plugins

Installation Information

• [ ] Installation From Source

• [ ] Docker Installation

• [X] Docker Compose Installation

• [ ] Cluster Installation

• [ ] AutoDL Image

• [ ] Other

Device information

Device: CPU rchitecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 39 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 8 On-line CPU(s) list: 0-7 Vendor ID: GenuineIntel BIOS Vendor ID: Intel(R) Corporation Model name: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz BIOS Model name: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz None CPU @ 2.9GHz

Models information

external LLM, Qwen-72B

What happened

root@ubuntu2404:~/DB-GPT-main# docker compose -f docker-compose.yml up -d [+] Running 1/2 ✔ Container db-gpt-main-db-1 Running 0.0s ⠹ Container db-gpt-main-webserver-1 Starting 0.2s Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy' nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown

What you expected to happen

Should be able to setup the docker and run with external LLM.

How to reproduce

Just try to docker compose on a server without GPU.

Additional context

No response

Are you willing to submit PR?

• [X] Yes I am willing to submit a PR!