LLaMA-Factory icon indicating copy to clipboard operation
LLaMA-Factory copied to clipboard

Published 20 hours ago • verified publisher icon hiyouga

[Draft] Add AutoRound support

Open wenhuach21 opened this issue 5 months ago • 2 comments

What does this PR do?

New Feature: Support AutoRound quantization algorithm which has shown benefit for finetuning https://substack.com/@bnjmnmarie/p-147609171

Before submitting

  • [x] Did you read the contributor guideline?
  • [ ] Did you write any new necessary tests? Not yet, only draft now, but test locally

wenhuach21 avatar Sep 19 '24 10:09 wenhuach21