ellama icon indicating copy to clipboard operation
ellama copied to clipboard

Context for new sessions

Open tbatchelli opened this issue 1 year ago • 1 comments

Use case: when I want to start a new session, I might want to first build the context before I send the prompt and start a new session.

Current state: context is attached to sessions, so if the session does not exist you can't attach context to it. When adding context and then creating a new session the context is added to the previous session instead. To start a new session with context you need to first create a session with a bogus prompt, which will get a (confused) response from the LLM, and then add the context and then run a new prompt in this new session, and then the second prompt has the context.

One option would be that the context is added in a session-free stack, and that only when you are about to issue a prompt the context is attached to the session before the chat is sent to the LLM

tbatchelli avatar Apr 19 '24 22:04 tbatchelli

If you have no active sessions it will be added to temporal location (variable) and will be used in new session. You can kill buffer with previous session instead of prompting with dummy message

s-kostyaev avatar Apr 20 '24 05:04 s-kostyaev

Should be fixed now

s-kostyaev avatar Jun 30 '24 17:06 s-kostyaev