jsonformer icon indicating copy to clipboard operation
jsonformer copied to clipboard

Published 20 hours ago • verified publisher icon 1rgs

ctransformers / GGML support

Open kw2828 opened this issue 2 years ago • 6 comments

hey any chance the team can work to provide ctransformers / GGML support? also key description options would be clutch, thanks

kw2828 avatar Jul 31 '23 12:07 kw2828

any update on this, i need to use this with llama cpp python

talhalatifkhan avatar Aug 16 '23 07:08 talhalatifkhan

And what about GPTQ models?

mhillebrand avatar Aug 18 '23 17:08 mhillebrand

I just created a PR that allows Jsonformer to work with auto-gptq:

https://github.com/1rgs/jsonformer/pull/36

mhillebrand avatar Aug 18 '23 18:08 mhillebrand

any update on this, i need to use this with llama cpp python

Where you able to get this working with llama ccp python?

kaosbeat avatar Mar 01 '24 13:03 kaosbeat

Need the same. Working with LLama-Cpp python.

projects-g avatar Mar 11 '24 16:03 projects-g

I also need to use this with LLama-Cpp python.

Peji-moghimi avatar Apr 12 '24 13:04 Peji-moghimi