parserllm icon indicating copy to clipboard operation
parserllm copied to clipboard
verified publisher icon r2d4

AutoGPTQ or EXLLAMA support?

Open ghost opened this issue 2 years ago • 0 comments

Hey I was trying to run quantized models using AutoGPTQ or EXLLAMA but it did not work at all. So I am asking if you are thinking about creating a version compatible with those?

ghost avatar Aug 12 '23 10:08 ghost