AutoGPTQ icon indicating copy to clipboard operation
AutoGPTQ copied to clipboard

Published 20 hours ago • verified publisher icon AutoGPTQ

[FEATURE] Merge Peft Adapter to base model

Open tridungduong16 opened this issue 1 year ago • 2 comments

Could AutoGPTQ support the merge model from adapter and base model?

tridungduong16 avatar Jul 25 '23 12:07 tridungduong16

Thank you for your suggestion! Will look into this!

PanQiWei avatar Jul 26 '23 06:07 PanQiWei

Bump. I'd love this feature so that I can run vLLM with my quantized model.

Thanks.

Peter-Devine avatar Mar 12 '24 07:03 Peter-Devine