transformers icon indicating copy to clipboard operation
transformers copied to clipboard

[`Awq`] Add peft support for AWQ

Open younesbelkada opened this issue 1 year ago • 2 comments

What does this PR do?

As per title, adds Trainer + AWQ + PEFT support. Needs to be merged at the same time as: https://github.com/huggingface/peft/pull/1399 The tests are directly added on https://github.com/huggingface/peft/pull/1399

cc @casper-hansen @pacman100 @amyeroberts

younesbelkada avatar Feb 13 '24 01:02 younesbelkada

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

cc @amyeroberts - we just got a release from autoawq ! this is ready for review 🙏 After merging this, I'll merge https://github.com/huggingface/peft/pull/1399 :)

younesbelkada avatar Feb 16 '24 07:02 younesbelkada

cool!

RanchiZhao avatar Apr 15 '24 12:04 RanchiZhao