chatglm.cpp icon indicating copy to clipboard operation
chatglm.cpp copied to clipboard

Published 20 hours ago • verified publisher icon li-plus

can not call tool by using q4_0 chatglm3 model

Open Mrfranken opened this issue 1 year ago • 0 comments

After installing all libs and downloading model, I trid to quantize it to q4_0, but can not call tool. Another drawback is model seems output repeated content.

Could u help to check?

Mrfranken avatar Dec 04 '23 13:12 Mrfranken