Have any plan to support chatglm serial models?

[user-ZJ]

[casper-hansen]

I plan to support new models as they come out. I focus most of my efforts on models that are better than previous models and mostly let others add older models through PRs.

[user-ZJ]

I plan to support new models as they come out. I focus most of my efforts on models that are better than previous models and mostly let others add older models through PRs.

I want to add chatglm2 and chatglm3 models. Is there any documentation to guide me how to add them?

[casper-hansen]

Hi @user-ZJ, I would love to support more models. There is no documentation yet, but that is subject to change as AutoAWQ now has a dedicated documentation page. Do you plan to try and add support yourself?

Documentation is live: https://casper-hansen.github.io/AutoAWQ/

[Dongru1]

Hi @user-ZJ. How about your progress？Are you working on the AWQ quantization of chatglm3 models?