text-generation-webui
text-generation-webui copied to clipboard
Setting up "flags" as presets for startup
I'm having a really hard time figuring out how to set up "flags" to run during startup. The wiki have a lenghy section describing how to do this for extensions, adding the string: python server.py --extensions enthusiasm translate # First apply enthusiasm, then translate
And almost all google searches about this wield results from last year, where that could be done by altering the "webuy.py" file, which seems that doesn't exist anymore.
I tought that start up presets where defined by the settings.yaml file, but there's no standard variable to call for "flags" it seems. I'm trying to add the "listen" and the "api" flags at the start up, because the way it's right now, if I check the box using the UI, it will work for the first time, but all subsequent startups will need to re-check "listen" and "api" and click on "Apply flags/extensions and restart".
Also, it would be nice to set a "model" to do the same. I really don't know if all of that is already possible, if so, I'm sorry. But I'm searching for this solution for a while now.
Thank you.
To save the model settings - you need to save the model settings on the model
tab. (Button save settings
)
To save session settings - you need to save the session settings on the session
tab. (Button save ui
)
The rest of the flags can be added to the text file CMD_FLAGS.txt
.