FRIDAY [Feature]: Real terminal integration

Is your feature request related to a problem? Please describe.

Nowadays computer agents struggle with terminal interface. They are incapable of REPL and shell environments.

Describe the solution you'd like

Introducing a fully capable terminal agent environment. Here are few things it can do.

You can see the position of the cursor, the range of the selected text.

tmux_show_1

You can also capture a screenshot of the terminal with cursor denoted in red.

vim_edit_tmux_screenshot

Grayscale augmented terminal gives high contrast to the red cursor, making the agent easier to locate it.

grayscale_dark_tmux

Would be great if OS-Copilot adopts this.

Describe alternatives you've considered

OpenDevin has a milestone over this. Devin as shown is already capable of doing this.

Additional context

You can learn more about my efforts here.

Aug 10 '24 02:08 James4Ever0

Would you please elaborate the reason closing this issue? @heroding77

Aug 10 '24 03:08 James4Ever0

So sorry that I initially thought it was unrelated advertising.

This looks interesting, and you're welcome to submit a PR to OS-Copilot!

Aug 11 '24 15:08 heroding77

Now it is available as an installable Python package.

pip install termadaptor

Aug 27 '24 04:08 James4Ever0

hi, this is super cool!! We are definitely considering integrating it, but we are in short of manpower. Put it on the todo list at the moment, will sort it out if we get some free hands.

Sep 03 '24 14:09 LividWo

Now you can use either Terminus 2 agent in Terminal Bench or use Termexec (my project).

https://tbench.ai/

https://pypi.org/project/termexec

Sep 21 '25 02:09 James4Ever0