hollama icon indicating copy to clipboard operation
hollama copied to clipboard

Summarize current session

Open fmaclen opened this issue 7 months ago • 0 comments

This would helpful as a form of token-count compression. Every 5-10 messages you could summarize and start over at a much lower token count but, hopefully, much more relevant.

  • When a session has 2 or more messages in the history a button appears with the label "Summarize"
  • Once clicked it changes the view to a full-screen form with these fields:
    • Choose Model select
    • Choose Knowledge select
    • A disabled "Prompt" texarea
    • A "Summarize" button to submit the form
  • After summarization the "Prompt" field becomes editable
  • The "Summarize" button is replaced with one that reads "New session"
  • Clicking "New Session" starts a new session with the summarized session as the new prompt.

fmaclen avatar Jul 02 '24 20:07 fmaclen