text-generation-inference
text-generation-inference copied to clipboard
Is there plan to support GPTQ?
Feature request
GPTQ is not supported yet in current version. Is there any timeline on that?
Motivation
quantization
Your contribution
can help with code if needed
Yes, GPT-Q will be supported once pr #438 is merged.
Closing this issue since GPTQ is supported now.