FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

GPU memory keeps growing with more talks, but the GPU memory is not released when the tallk is closed.

Open 0Xiao0 opened this issue 1 year ago • 0 comments

I used the local model about 40GB, then increased it to 50GB as the coversation increased, but couldn't free the GPU when exited the conversations

0Xiao0 avatar Apr 07 '24 06:04 0Xiao0