jsonformer icon indicating copy to clipboard operation
jsonformer copied to clipboard

Published 20 hours ago • verified publisher icon 1rgs

Support for GPTQ models

Open projects-g opened this issue 11 months ago • 0 comments

Jsonformer doesn't work with GPTQ models. For inference speed, it would be nice to have support for such models.

projects-g avatar Mar 11 '24 17:03 projects-g