hollama icon indicating copy to clipboard operation
hollama copied to clipboard

Projects: re-usable system prompt, model settings and context

Open fmaclen opened this issue 7 months ago • 1 comments

This issue describes a new high-level entity called "Projects". Loosely inspired by Claude's: https://www.anthropic.com/news/projects

  • Projects could include:
    • System prompt
    • One or more additional Knowledge for context
    • Advanced model options (i.e temperature, seed, etc)
  • User could start a New session and choose a Project which would apply all of the parameters/context.

Additional thoughts:

  • If user chooses a Project when starting a New session, should the settings be updatable at that point?
  • Should the settings be updatable in the middle of an existing Session?
  • If these options need to be editable we might want to use use the initial Project as a "base template" that we apply and store together with a Session.
  • One thing to consider if we treat Projects as templates and we "create copies" for every New session is that it could have a noticeable negative impact in performance/storage capacity.

For reference, here's a screenshot from OpenWebUI for the Advanced controls when creating a new chat:

localhost_3000_

fmaclen avatar Jul 24 '24 14:07 fmaclen