text-generation-webui
text-generation-webui copied to clipboard
Generation parameters do not update based on presets when changing model
Describe the bug
I'm not sure if this is intended to only work on the first load when using the start-webui script with the selection menu, but when changing the model in the Gradio UI (in the "Model" tab), the "Generation parameters preset" in the "Parameters" tab does not update to the value set in the "settings.json" file
Is there an existing issue for this?
- [X] I have searched the existing issues
Reproduction
For example, if I have the following in settings.json
"presets": {
"default": "Default",
".*(alpaca|llama)": "LLaMA-Precise",
".*(vicuna|koala)": "Default",
".*pygmalion": "Pygmalion",
".*RWKV": "Naive"
},
and then start the webui with the parameters --auto-devices --chat --sdp-attention
,
when I select the model LLaMA 13b
in the Gradio UI, the Generation parameters preset
dropdown (along with the actual parameters) stays on Default
instead of changing to LLaMA-Precise
The same happens when switching from one model to another
Screenshot
No response
Logs
N/A
System Info
Windows 10
NVIDIA 4090
I seem to notice this too. All models load with "default". Lately I have just been starting the server and picking from the web-ui instead of using command line args.
This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.