open-interpreter icon indicating copy to clipboard operation
open-interpreter copied to clipboard

Add real terminal support

Open James4Ever0 opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe.

OpenInterpreter currently is unable to interact with common REPL and shell environment in an asynchronous way. It is always blocking.

Describe the solution you'd like

Introducing a fully capable terminal agent environment. Here are few things it can do.

You can see the position of the cursor, the range of the selected text.

tmux_show_1

You can also capture a screenshot of the terminal with cursor denoted in red.

vim_edit_tmux_screenshot

Grayscale augmented terminal gives high contrast to the red cursor, making the agent easier to locate it.

grayscale_dark_tmux

Would be great if OpenInterpreter adopts this.

Describe alternatives you've considered

OpenDevin has a milestone over this. Devin as shown is already capable of doing this.

Additional context

You can learn more about my efforts here.

James4Ever0 avatar Aug 10 '24 02:08 James4Ever0

Now you can use either Terminus 2 agent in Terminal Bench or use Termexec (my project).

https://tbench.ai/

https://pypi.org/project/termexec

James4Ever0 avatar Sep 21 '25 02:09 James4Ever0