julep
julep copied to clipboard
feat: Add dialog entries summarization
trafficstars
| :rocket: | This description was created by Ellipsis for commit fa5b52d3015d6c89924dd73f5ac9f5a6cf95eea3 |
|---|
feat: Add dialog entries summarization and update truncation logic
Summary:
Enhance dialog entries summarization and update truncation logic for improved chat session management.
Key points:
- Summarization: Implement
summarization()usingsummarize_messages,get_entities, andtrim_messagesinsummarization.py. Addentries_summarization_queryandget_toplevel_entries_queryinentries_summarization.py. - Truncation: Implement
truncation()intruncation.pyto delete entries based on token count. Addget_extra_entriesfunction intruncation.py. - Workflow: Modify
TruncationWorkflowintruncation.pyto includedeveloper_id. Addrun_truncation_taskandrun_summarization_taskintemporal.py. - Chat Handling: Update
chat.pyto handle context overflow and raisePromptTooBigError. - Miscellaneous: Change response type in
create_or_update_session.pytoResourceUpdatedResponse. Add debug print inlitellm.py.
Generated with :heart: by ellipsis.dev