chatbot-ui icon indicating copy to clipboard operation
chatbot-ui copied to clipboard

Advice: Customize for a single FT model

Open wmodes opened this issue 10 months ago • 1 comments

Not an actual issue, but a broad question about customization. Probably not at all what you are excited to talk about.

I am currently serving a custom model through my own homebuilt UI (https://bot.wmod.es), but am considering switching to chatbot-ui. What do you suggest is the most elegant way to tailor the app to serve a single fine-tuned model? I've been staring at and experimenting with various hacks.

  • Hack the database migrations scripts? Or the code?
  • If I hack the database migrations (in general, just adding records to workspaces and models), how do I automatically apply these when new users are created?
  • How to lock down features so most of the fancy customization features are disabled for ussers?
  • Is there an admin role that would still allow me to use these features to try out new models?

I'm trying not to make too drastic changes because I want to still be able to pull updates from the upstream repo without a freeway pileup of conflicts.

wmodes avatar Apr 08 '24 00:04 wmodes

There's an unused "sharing" flag on each of the custom models/assistants I've been using to set master models. Superusers can see and edit the models directly but regular users can just use the models. It's a bit custom but it's definitely doable. To hide the extra functionality you'd probably just want to add logic so that only superusers get to see those features etc.

tysonvolte avatar Apr 10 '24 07:04 tysonvolte