onlook icon indicating copy to clipboard operation
onlook copied to clipboard

fix: prevent chat conversations from exceeding token context limit

Open iNerdStack opened this issue 1 week ago • 0 comments

Description

Fixed chat conversations exceeding the LLM token context limit (200,000) when accumulating too many messages.

  • Implemented conversation summarization when approaching token limits:
  • Generates concise technical summaries of previous conversations

Related Issues

Type of Change

  • [x] Bug fix
  • [ ] New feature
  • [ ] Documentation update
  • [ ] Release
  • [ ] Other (please describe):

Testing

Screenshots (if applicable)

Additional Notes

iNerdStack avatar Feb 20 '25 05:02 iNerdStack