text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Setting up "flags" as presets for startup

Open guispfilho opened this issue 9 months ago • 1 comments

I'm having a really hard time figuring out how to set up "flags" to run during startup. The wiki have a lenghy section describing how to do this for extensions, adding the string: python server.py --extensions enthusiasm translate # First apply enthusiasm, then translate

And almost all google searches about this wield results from last year, where that could be done by altering the "webuy.py" file, which seems that doesn't exist anymore.

I tought that start up presets where defined by the settings.yaml file, but there's no standard variable to call for "flags" it seems. I'm trying to add the "listen" and the "api" flags at the start up, because the way it's right now, if I check the box using the UI, it will work for the first time, but all subsequent startups will need to re-check "listen" and "api" and click on "Apply flags/extensions and restart".

Also, it would be nice to set a "model" to do the same. I really don't know if all of that is already possible, if so, I'm sorry. But I'm searching for this solution for a while now.

Thank you.

guispfilho avatar May 14 '24 21:05 guispfilho

To save the model settings - you need to save the model settings on the model tab. (Button save settings) To save session settings - you need to save the session settings on the session tab. (Button save ui)

The rest of the flags can be added to the text file CMD_FLAGS.txt.

Alkohole avatar May 14 '24 22:05 Alkohole