TaxDodger comments

Repositories
Issues
Comments

Results 3 comments of


                                            TaxDodger

stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors fails to load

FOUND THE SOLUTION : 1. Go to "TextGen-WebUI\text-generation-webui\repositories\GPTQ-for-LLaMa" 2. Open this file in a text editor : "llama_inference_offload.py" 3. Go to line 21, and create a new line below it...

stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors fails to load

@hpnyaggerman Sure here it is : https://pastebin.com/raw/PzbddAG6 You don't really need it though, just add that one line of code and it should resolve it And yes, I also got...

stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors fails to load

> > FOUND THE SOLUTION : > > ``` > > 1. Go to "TextGen-WebUI\text-generation-webui\repositories\GPTQ-for-LLaMa" > > > > 2. Open this file in a text editor : "llama_inference_offload.py" >...