julep icon indicating copy to clipboard operation
julep copied to clipboard

feat: Add dialog entries summarization

Open whiterabbit1983 opened this issue 1 year ago • 0 comments
trafficstars

:rocket: This description was created by Ellipsis for commit fa5b52d3015d6c89924dd73f5ac9f5a6cf95eea3

feat: Add dialog entries summarization and update truncation logic

Summary:

Enhance dialog entries summarization and update truncation logic for improved chat session management.

Key points:

  • Summarization: Implement summarization() using summarize_messages, get_entities, and trim_messages in summarization.py. Add entries_summarization_query and get_toplevel_entries_query in entries_summarization.py.
  • Truncation: Implement truncation() in truncation.py to delete entries based on token count. Add get_extra_entries function in truncation.py.
  • Workflow: Modify TruncationWorkflow in truncation.py to include developer_id. Add run_truncation_task and run_summarization_task in temporal.py.
  • Chat Handling: Update chat.py to handle context overflow and raise PromptTooBigError.
  • Miscellaneous: Change response type in create_or_update_session.py to ResourceUpdatedResponse. Add debug print in litellm.py.

Generated with :heart: by ellipsis.dev

whiterabbit1983 avatar Sep 11 '24 20:09 whiterabbit1983