gpt4all.unity icon indicating copy to clipboard operation
gpt4all.unity copied to clipboard

Published 20 hours ago • verified publisher icon Macoron

Doesn't work with 4bit?

Open dreemur99 opened this issue 1 year ago • 3 comments

Tried using with several ggml bins (some from TheBloke, some from GPT4All) and it seems like this code only works with models not labeled as 4bit? Or am I missing something?

dreemur99 avatar Jul 20 '23 04:07 dreemur99