optimum-intel icon indicating copy to clipboard operation
optimum-intel copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Update default 4bit configs

Open KodiaqQ opened this issue 9 months ago • 3 comments

What does this PR do?

Contains configuration updates based on the experiments from 135227 and following PR's:

  • https://github.com/openvinotoolkit/openvino.genai/pull/377
  • https://github.com/openvinotoolkit/openvino.genai/pull/419

Before submitting

  • [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • [ ] Did you make sure to update the documentation with your changes?
  • [ ] Did you write any new necessary tests?

KodiaqQ avatar May 08 '24 10:05 KodiaqQ