OpenHands
OpenHands copied to clipboard
Add the option to reduce context window
End-user friendly description of the problem this fixes or functionality that this introduces
- [ ] Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below
Give a summary of what the PR does, explaining any non-trivial design decisions
With the https://github.com/All-Hands-AI/OpenHands/pull/4977 change being in 0.14, now we should allow users to set a lower context window than their LLMs maximum context window size. This allows the code to perform better if the model's performance degrades too significantly if you use the maximum context window, you can use this to set a shorter window, manually.
Link of any specific issues this addresses