call-gpt icon indicating copy to clipboard operation
call-gpt copied to clipboard

Summarize GPT Chat history as more queries are added to the conversation

Open cweems opened this issue 1 year ago • 0 comments

Currently, responses get increasingly slower as the chat context grows. We should implement a gradual rolloff of older queries that get summarized by GPT and then added to the end of the conversation.

This may require some testing to understand the optimal conversation context size based on quality of results and speed to response.

cweems avatar Dec 13 '23 18:12 cweems