Would you like to provide the chatglm int4 ggml model ?

[hongkyunn]

Would you like to provide the chatglm int4 ggml model ?

[li-plus]

I'd love to, but this repo is under active development. The model format might change frequently. For now please stick to the latest source code to generate the ggml model. I'll consider releasing it when it's stable.

[WangFengtu1996]

是考虑生成 GGUF 格式的模型int4 量化模型么？现在有啥新的进展么？