litellm icon indicating copy to clipboard operation
litellm copied to clipboard
Published 1 week ago • verified publisher icon BerriAI

[Feature]: AQLM models proxy support

Open Mayorc1978 opened this issue 1 year ago • 0 comments

The Feature

Support for SOTA AQLM quantized models.

Motivation, pitch

Being the SOTA for 2bit models it should be incorporated in LiteLLM.

Twitter / LinkedIn details

No response

Mayorc1978 avatar Apr 07 '24 18:04 Mayorc1978