Blake Wyatt

@HB-Stratos I've seen a lot of problems with this model. It looks like there's an incompatibility between how the model was built and how it's being used by the transformers...

@HB-Stratos As far as I know, I'm afraid not

if I'm understanding you correctly, yes, that's what this script does. It changes the GUID of a save

No worries, sorry you weren't able to use the tool, hopefully it will work better in the future after I make some improvements!

@SoftologyPro I had this problem and fixed it. I wrote some installation instructions over [here](https://github.com/xNul/chat-llama-discord-bot#llama-setup-normal8bit4bit-for-text-generation-webui) for my Discord bot if you want to try them.

> Like I said, you are better off installing the wheel file that I uploaded: [#457 (comment)](https://github.com/oobabooga/text-generation-webui/issues/457#issuecomment-1477075495) TBH, I don't really know why compilation started working for me. At first,...

> When recompiling GPTQ on Windows, I accidentally forgot to use the x64 native tools cmd. It then successfully compiled using Visual Studio 2022 on its own, which is interesting...

@KnoBuddy if delete your environment and files and rollback text-generation-webui to two days ago, [these instructions](https://github.com/xNul/chat-llama-discord-bot#llama-setup-normal8bit4bit-for-text-generation-webui) I made should work for you. You might be able to replace the `python...

Hmm my guess is that it can't find the model you're specifying. Make sure it exists in the `text-generation-webui/models` directory and that the name of the folder of the model...

I had to fix this as well and did it on Windows (no WSL). Here are my steps. Hopefully this saves someone else hours of work. # Windows (no WSL)...