Leverage chat history to improve over time

[humphd]

I noticed today people talking about this:

We already keep full history, but we don't do anything with it. I wonder if we could generate a system prompt that is based on your past chats?

There are some challenges here, since it would require processing a lot of tokens. Have to think about how to use this history to help users.