state-of-open-source-ai icon indicating copy to clipboard operation
state-of-open-source-ai copied to clipboard

Published 20 hours ago • verified publisher icon premAI-io

Include quantization techniques

Open filopedraz opened this issue 2 years ago • 0 comments

Type

new chapter

Chapter/Page

Something else

Description

I suggest that we have a separate chapter on Quantization. The chapter should include all the new methods created to handle quantization and the most famous libraries associated with them.

  • GPTQ
  • AWQ

filopedraz avatar Oct 07 '23 20:10 filopedraz