[Feature]: context length exceeded error

[droot]

A few users have reported that they are running in context length exceeded error. In most of the instances, it involved fetching/analyzing logs in the system and that could get very verbose.

Today when a user runs into this issue, they either have to terminate the session or reset the conversation history (this was not working before, I believe is fixed in the session persistence PR). Both of these options are not great because user end up losing the entire conversation. Task here is to come up with ways to handle this scenario better. For ex. one option could be to introduce a command called compact, that can replace the current conversation history with the summary of the conversation so far.

/cc @ShubyM