letta
letta copied to clipboard
/summarize command fails
Describe the bug
Using ollama with dolphin2.2-mistral:7b-q8_0
and chatml
wrapper. Cannot summarize in place.
Please describe your setup
- [x] How did you install memgpt?
-
pip install pymemgpt
?pip install pymemgpt-nightly
?git clone
? - Installed with pip install pymemgpt
-
- [x] Describe your setup
- What's your OS (Windows/MacOS/Linux)? Linux
- How are you running
memgpt
? memgpt run
Debug log:
> Enter your message: /summarize
MESSAGE_SUMMARY_TRUNC_TOKEN_FRAC=0.75
MESSAGE_SUMMARY_TRUNC_KEEP_N_LAST=3
token_counts=[88, 68, 48, 98, 70, 104, 70, 86, 68, 87]
message_buffer_token_count=1011
desired_token_count_to_summarize=758
len(candidate_messages_to_summarize)=10
Selected cutoff 10 was a 'user', shifting one...
Attempting to summarize 9 messages [1:10] of 14
Using model ollama, endpoint: http://localhost:11434
unsetting function_call because functions is None
'function_call'
/summarize failed:
Failed to convert ChatCompletion messages into prompt string with wrapper <memgpt.local_llm.llm_chat_completion_wrappers.simple_summary_wrapper.SimpleSummaryWrapper object at 0x7f9973d7a6e0> - error: 'function_call'
Figured out the issue. Submitting patch for this.