technologic
technologic copied to clipboard
Context length Issues
There are several things we need to keep in mind when it comes to context length.
[ ] Context length configuration parameter for models [ ] Handle context length errors when talking to the backend [ ] show how long the current context is [ ] (Maybe) show how expensive the conversation is and how much it would cost to continue it