text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Generation parameters do not update based on presets when changing model

Open DavG25 opened this issue 1 year ago • 1 comments

Describe the bug

I'm not sure if this is intended to only work on the first load when using the start-webui script with the selection menu, but when changing the model in the Gradio UI (in the "Model" tab), the "Generation parameters preset" in the "Parameters" tab does not update to the value set in the "settings.json" file

Is there an existing issue for this?

  • [X] I have searched the existing issues

Reproduction

For example, if I have the following in settings.json

"presets": {
    "default": "Default",
    ".*(alpaca|llama)": "LLaMA-Precise",
    ".*(vicuna|koala)": "Default",
    ".*pygmalion": "Pygmalion",
    ".*RWKV": "Naive"
},

and then start the webui with the parameters --auto-devices --chat --sdp-attention, when I select the model LLaMA 13b in the Gradio UI, the Generation parameters preset dropdown (along with the actual parameters) stays on Default instead of changing to LLaMA-Precise

The same happens when switching from one model to another

Screenshot

No response

Logs

N/A

System Info

Windows 10
NVIDIA 4090

DavG25 avatar Apr 21 '23 15:04 DavG25

I seem to notice this too. All models load with "default". Lately I have just been starting the server and picking from the web-ui instead of using command line args.

Ph0rk0z avatar Apr 21 '23 15:04 Ph0rk0z

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.

github-actions[bot] avatar May 21 '23 23:05 github-actions[bot]