Add real terminal environment
Operate systems initially only provide text-only terminal interfaces, before GUI appears. Terminal is less resource intensive, more lightweight therefore can scale more easily than GUI. Besides, most LLMs are text-only.
I have developed a general purpose terminal interaction environment for AI agents such as OpenDevin and OpenInterpreter. Here are few things it can do.
You can see the position of the cursor, the range of the selected text.
You can also capture a screenshot of the terminal with cursor denoted in red.
Grayscale augmented terminal gives high contrast to the red cursor, making the agent easier to locate it.
Would you like to add it to CRAB? This further enhances the agent capability, empower it to interact more with the OS.
You can learn more here.
@James4Ever0 this environment is very interesting to me! We will carefully read and try to add it. Thank you for your suggestion!
Now it is available as an installable Python package.
pip install termadaptor
Now you can use either Terminus 2 agent in Terminal Bench or use Termexec (my project).
https://tbench.ai/
https://pypi.org/project/termexec