webarena icon indicating copy to clipboard operation
webarena copied to clipboard

Using webarena in async environment?

Open zhudotexe opened this issue 7 months ago • 3 comments

Is there a way to use the webarena ScriptBrowserEnv in an async context? For some context on my use case, I'm not using the bundled run.py, but rather building up my own eval loop (following minimal_example.py as a guideline).

The system I'm working on requires running as async, and it seems like WebArena is tightly coupled with the Sync API of Playwright (which in turn does not play nice with another asyncio loop running in parallel). I've done some digging and see that there's an AsyncScriptBrowserEnv, but this does not seem to match the API of ScriptBrowserEnv. Do you have any additional context as to how we might accomplish this?

zhudotexe avatar Jun 27 '24 22:06 zhudotexe