DB-GPT icon indicating copy to clipboard operation
DB-GPT copied to clipboard
verified publisher icon eosphoros-ai

[BUG]: When using DB-GPT, with the continuous questioning, CUDA memory has been increasing until memory exploded

Open Steffy-zxf opened this issue 2 years ago • 1 comments

Follow the tutorial to deploy DB-GPT on the ubuntu machine, 24g single-card GPU. As I continued to ask questions, CUDA memory kept increasing until memory exploded. How to free video memory?

Steffy-zxf avatar Jun 02 '23 09:06 Steffy-zxf

During inference, the video memory itself will grow，We are also looking for a solution.

csunny avatar Jun 02 '23 12:06 csunny

Hi, any solution for this issue? I have the same issue and need to always restart llm server

YangZeyu95 avatar Jul 20 '23 03:07 YangZeyu95