chatbot-ui
chatbot-ui copied to clipboard
Advice: Customize for a single FT model
Not an actual issue, but a broad question about customization. Probably not at all what you are excited to talk about.
I am currently serving a custom model through my own homebuilt UI (https://bot.wmod.es), but am considering switching to chatbot-ui. What do you suggest is the most elegant way to tailor the app to serve a single fine-tuned model? I've been staring at and experimenting with various hacks.
- Hack the database migrations scripts? Or the code?
- If I hack the database migrations (in general, just adding records to workspaces and models), how do I automatically apply these when new users are created?
- How to lock down features so most of the fancy customization features are disabled for ussers?
- Is there an admin role that would still allow me to use these features to try out new models?
I'm trying not to make too drastic changes because I want to still be able to pull updates from the upstream repo without a freeway pileup of conflicts.
There's an unused "sharing" flag on each of the custom models/assistants I've been using to set master models. Superusers can see and edit the models directly but regular users can just use the models. It's a bit custom but it's definitely doable. To hide the extra functionality you'd probably just want to add logic so that only superusers get to see those features etc.