OpenHands icon indicating copy to clipboard operation
OpenHands copied to clipboard

Add the option to reduce context window

Open ryx2 opened this issue 3 months ago • 9 comments

End-user friendly description of the problem this fixes or functionality that this introduces

  • [ ] Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below

Give a summary of what the PR does, explaining any non-trivial design decisions

With the https://github.com/All-Hands-AI/OpenHands/pull/4977 change being in 0.14, now we should allow users to set a lower context window than their LLMs maximum context window size. This allows the code to perform better if the model's performance degrades too significantly if you use the maximum context window, you can use this to set a shorter window, manually.


Link of any specific issues this addresses

ryx2 avatar Nov 16 '24 02:11 ryx2