open-interpreter icon indicating copy to clipboard operation
open-interpreter copied to clipboard

Continuous Chat

Open JamesClarke7283 opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe.

When i hit the context window limit, i get an error, saying ive gone over the token limit.

Describe the solution you'd like

I would like to see different modes for continuing the chat, without having to restart, one could be, summarizing the chat into 4096 (or whatever the input max is(or user configurable)) tokens, so that the AI still has some idea about what the conversation is about.

Describe alternatives you've considered

You could have it remember in its knowledge base, the files you have uploaded so far for this session. this will help it understand what the chat was about better, but i think combining it with chat summerization or at least getting the first 1-3 prompts and feeding it back into it, would be nice.

Additional context

ChatGPT Web does something similar where it summarizes the prompts into one prompt. you might want to take inspiration from that/

JamesClarke7283 avatar Jan 20 '24 07:01 JamesClarke7283