AQLM icon indicating copy to clipboard operation
AQLM copied to clipboard
verified publisher icon Vahe1994

AQLM for VLM

Open LugerW-A opened this issue 5 months ago • 1 comments

can we use AQLM for multi modal LLM?

LugerW-A avatar Jul 18 '25 03:07 LugerW-A

Hi, @LugerW-A we have not tried so far. But I think the language component of the multimodal model should be quantizable in a similar fashion to LLM.

Godofnothing avatar Jul 31 '25 20:07 Godofnothing