big-AGI icon indicating copy to clipboard operation
big-AGI copied to clipboard

Three updates to AI purpose

Open Sput opened this issue 1 year ago • 3 comments

Really enjoying playing with this, I think you have the beginnings of a really useful product.

  1. For my purposes, I would prefer to have the AI purpose dropdown to be visible along with the chat window.
  2. I would like to be able to change the AI purpose without refreshing the page. If the item above was implemented, then you could change the AI purpose without refreshing the page.
  3. The API allows for more context to be submitted with the prompt. Currently you support the 'system' role, but the API also supports 'user' and 'assistant' roles in this style: {"role": "system", "content": "You are the assistant to a Dungeon Master running the game 'Dungeons and Dragons'."},
    {"role": "user", "content": "How much damage does magic missile do when cast from a 5th level spell slot?"},
    {"role": "assistant", "content": "When cast at 5th level, magic missile deals 5d4 + 5 force damage,"},

Sput avatar Mar 20 '23 01:03 Sput

What if on the top bar (it says 'gpt-4' now) we have a selectable network and purpose. So it could say "3.5-Turbo - Developer", or "GPT-4 - Scientist".

Hovering the 2 parts will show a dropdown box to change the network or change the purpose, which will apply to the very next reply. Technically, despite having the system message being the initial message of a conversation, I believe it wouldn't be a problem to replace the system message on the fly - i.e. hopefully a former 'purpose' will not anchor the conversation too deeply to that former purpose.

Another possibility is to have 'purpose' as different actors in the conversation. For instance "Developer has entered the chat" while you're having a conversation with the Dungeon Master.

Which implementations would work better, a single chat with switchable purpose, or more actors dropped into the chat?

enricoros avatar Mar 20 '23 19:03 enricoros

For my purposes I'm trying to use this for separate and compartmentalized functions (work & play), so I would prefer they be switchable. That being said, your idea of being able to drop additional purposes into the chat would be fun.

Sput avatar Mar 20 '23 19:03 Sput

Also to address your design idea of the selectable network and purpose, yes, that's exactly how I envisioned it, you understood my idea exactly.

Sput avatar Mar 20 '23 20:03 Sput

Getting there. Now the state is synchronized across the application, and reflected on the top bar. We're almost at the stage of selecting the nets/roles from the top bar.

image

enricoros avatar Mar 22 '23 08:03 enricoros

I'm thinking of adding an editor for 'purposes', so that you'd be able to have multiple custom purposes, tailor them to your needs, and switch quickly between them. Lmk if an editor (not a small feature) will work.

enricoros avatar Mar 24 '23 07:03 enricoros

I apologize for the late response. I think your recommendation makes sense, right now I'm editing them in the code, which works for developers, but won't scale to normal users.

Sput avatar Mar 31 '23 11:03 Sput

Hi @Sput, the project has made large progress lately. Have you updated your workflow, and do you have a good system prompt to share? I'm thinking at how to offer good editing (#35 ) or customization either with UI, or simply maintaining a json file. Would love to hear your inputs.

enricoros avatar Apr 05 '23 03:04 enricoros

  • For my purposes, I would prefer to have the AI purpose dropdown to be visible along with the chat window.

1. This is done!

2. I would like to be able to change the AI purpose without refreshing the page. If the item above was implemented, then you could change the AI purpose without refreshing the page.

2. This is done!

3. The API allows for more context to be submitted with the prompt. Currently you support the 'system' role, but the API also supports 'user' and 'assistant' roles in this style:

  1. I think this is duplicate of #35 . Will close this for now, and will reopen when I hear information about what's the different ask in this (see my former message)

enricoros avatar Apr 05 '23 04:04 enricoros

thank you for this, your updates are great, coming fast and furious! I think prompt sharing is the next great frontier. I haven't found any sites that I think do this well. To do that right, its probably a whole other app that would need to be built (maybe I'll be the one to build it). Until then, I'm going to start a discussion thread, and supply mine, see if others have content to add.

Sput avatar Apr 06 '23 19:04 Sput

coming fast and furious Thanks :) Tonight we have pixel perfection (markdown and some tiles update) - wait for something really cool really soon.

maybe I'll be the one to build it Would love so! and you should have some central API/repository that I can query from this app as well

I'm going to start a discussion thread, and supply mine, see if others have content to add. Please do!!

enricoros avatar Apr 07 '23 12:04 enricoros