gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

Published 20 hours ago • verified publisher icon nomic-ai

How can I use Wizard-Vicuna-30B-Uncensored-GGML?

Open Victoralm opened this issue 1 year ago • 3 comments

Feature request

Is there a way to put the Wizard-Vicuna-30B-Uncensored-GGML to work with gpt4all?

Motivation

I'm very curious to try this model

Your contribution

I'm very curious to try this model

Victoralm avatar Jun 02 '23 02:06 Victoralm

If I'm not mistaken, this is due to an architecture change, and will be supported in the next release.

verbiate avatar Jun 02 '23 03:06 verbiate

I would also like to test out these kind of models within GPT4all. Is it even possible to place manual model files in the folders and make them show up in the GUI? I guess if that is possible, we can only use certain.bin files and not .safetensors files, right?

Xonar92 avatar Jun 02 '23 12:06 Xonar92

If I'm not mistaken, this is due to an architecture change, and will be supported in the next release.

Not sure when exactly, but yes I'd say you're right. In fact, I'm running Wizard-Vicuna-7B-Uncensored.ggmlv3.q4_1.bin right now. But not with the official chat application, it was built from an experimental branch. I don't know what limitations there are once that's fully enabled, if any.

I would also like to test out these kind of models within GPT4all. Is it even possible to place manual model files in the folders and make them show up in the GUI? I guess if that is possible, we can only use certain.bin files and not .safetensors files, right?

It's possible, but they need to have the right format. And there was a breaking change to the format earlier this month, so there are incompatibilities. But as mentioned, the devs are trying to resolve that.

There are some converter scripts somewhere to enable models other than the ones offered through the downloader I think, but I've never tried that myself.

cosmic-snow avatar Jun 02 '23 14:06 cosmic-snow

Works now.

niansa avatar Jun 08 '23 14:06 niansa

Hi where can i download that Wizard-Vicuna-7B-Uncensored.ggmlv3.q4_1.bin couldnt find the link anywhere

thexmeta avatar Jun 13 '23 19:06 thexmeta

Uh, I added that link to the repository? Not sure how you cannot find that.

But as I said, it was not with the official chat application but a custom build on an experimental branch.

cosmic-snow avatar Jun 13 '23 19:06 cosmic-snow

Uh, I added that link to the repository? Not sure how you cannot find that.

But as I said, it was not with the official chat application but a custom build on an experimental branch.

i am confused how i couldnt find it before, sorry for that :)

thexmeta avatar Jun 27 '23 00:06 thexmeta