Bartowski

Text generation webui no longer supports the old .bin format, use a newer GGUF: https://huggingface.co/TheBloke/Chinese-Llama-2-7B-GGUF

Glad it worked! Feel free to close this as resolved :)

Gonna need a lot more info here, please follow the suggestions provided for filling a bug report

No one will be able to help if you don't provide basic information like what your system is or how you installed it

What version and browser? What install method? Any difference when using incognito?

I may be wrong but I know I've had issues trying to mount a folder directly inside the working directory with docker, so you may be better off setting it...

I would guess you change container port in the .env file

> I encountered a follow-up issue where my browser would not load the web UI (connection keeps getting "reset" while loading). If you're impatient like me, you can add `network_mode:...

Are you able to generate anything? Loading works but as soon as I try to prompt it it errors

Okay so reinstalling everything from scratch and specifying the torch version seemed to have fixed it, not sure what specific part but looks like it's working with HF now, sorry...