text-generation-webui
text-generation-webui copied to clipboard
Restarting gets stuck if LLaVA(extension) is enabled.
Describe the bug
When trying to restart the webui from the "interface mode" tab it gets stuck at the reloading... message and there is no output in the log. It will only get stuck if LLaVA extension is loaded before restarting, it will work when enabling LLaVA during the restart. Does not matter what options are changed even disabling LLaVA will get it stuck.
Can happen for some other reason, but for me llava is one that triggers it.
Is there an existing issue for this?
- [X] I have searched the existing issues
Reproduction
- Have LLaVA extension enabled.
- Restart webui fron interface mode tab
- Stuck at reloading, no console output
Screenshot
No response
Logs
No output
System Info
WSL2 Ubuntu-22.04
GPTQ-for-LLaMA triton
RTX 3080 10 GB
Ryzen 5800X
24 GB RAM
webui c83210c
model: wojtab/llava-13b-v0-4bit-128g (fully on gpu)
I don't think it's llava, same thing happens for me without the extension
It did happen to me without llava at some point but I don't remember what it might have been.
This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.