OpenHands icon indicating copy to clipboard operation
OpenHands copied to clipboard

Frontend: Implement browser tab

Open neubig opened this issue 1 year ago • 2 comments

In the actual Devin demo there is a browser tab that allows the user to see which pages the assistant is currently looking at. But we do not have such a tab within our current prototype frontend.

We could add such a tab. Contributors for this welcome!

neubig avatar Mar 18 '24 00:03 neubig

I would like to work on this issue, could you please assign this task to me!!

Akshat-0001 avatar Mar 18 '24 17:03 Akshat-0001

If the assistant views webpages through Selenium, it can send a screenshot every second (or every page update) to the frontend, which this tab can render.

Embedding an <iframe /> is also possible but might have security/reliability issues (such as CORS).

yimothysu avatar Mar 19 '24 00:03 yimothysu

Yeah, I think that the selenium screenshot might be the appropriate way to do things here, nice idea @yimothysu !

neubig avatar Mar 19 '24 01:03 neubig