transformers
transformers copied to clipboard
[`Awq`] Add peft support for AWQ
What does this PR do?
As per title, adds Trainer + AWQ + PEFT support. Needs to be merged at the same time as: https://github.com/huggingface/peft/pull/1399 The tests are directly added on https://github.com/huggingface/peft/pull/1399
cc @casper-hansen @pacman100 @amyeroberts
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
cc @amyeroberts - we just got a release from autoawq ! this is ready for review 🙏 After merging this, I'll merge https://github.com/huggingface/peft/pull/1399 :)
cool!