BrowserGym

BrowserGym copied to clipboard

I’m using openai api to implement the agent, and enable thinking feature within browsergym to observe the assistant’s thinking process with special tag When I use the tag : messages=[...

XueyingJia

For Python 3.13 https://github.com/python-greenlet/greenlet/issues/392#issuecomment-2446961814 ## Description by Korbit AI ### What change is being made? Update the `playwright` package version from `1.39` to `1.50` in the `requirements.txt` file. ### Why...

SmartManoj

[Feature Request] Support download action

3

It seems Playwright supports download: https://playwright.dev/docs/api/class-download Motivated by: https://github.com/All-Hands-AI/OpenHands/issues/5089

li-boxuan

Fix https://github.com/ServiceNow/BrowserGym/issues/308

kripper

Evaluation in WA differs from the official implementation

2

Why call the evaluator at every step? In the official implementation, it only evaluates at the final step. https://github.com/ServiceNow/BrowserGym/blob/ec6b802cd655f2c6a84ebd66a22a4435d8147272/browsergym/webarena/src/browsergym/webarena/task.py#L185C9-L185C11 https://github.com/web-arena-x/webarena/blob/df352854eef255b007110948f6d4f539af039717/run.py#L330

hysyyds

Hi, I'm running assistantbench and I found CAPTCHA verification is pretty annoy, leading LLM agents to output: report_infeasible("I cannot proceed with the search because the page is displaying a CAPTCHA...

rowingchenn

Fails to load certain start_urls in headless mode

2

Hi! I want to collect trajectories of a llm in the internet. As I am using a cluster for this, i use the headless=True flag. I initialize my env as:...

korbinian-hoermann

[Feature request] Add function get_element_html(bid)

1

Plase add a new function in [functions.py](https://github.com/ServiceNow/BrowserGym/blob/main/browsergym/core/src/browsergym/core/action/functions.py) to return the HTML of a element identified by its `bid`. This is for https://github.com/All-Hands-AI/OpenHands/issues/5727#issuecomment-2603470848

kripper

"timeout" arg missing for EnvArgs to instantiate BrowserEnv is missing

1

Hi, I noticed some missing arguments in EnvArgs for instantiating BrowserGym with full configurations. For example, `timeout` is not configurable in EnvArgs, and the timeout for context or page configuration...

rowingchenn

Could we implement this? ```python Benchmark.get_version() -> str ``` meant to replace this code: ```python def _get_benchmark_version(benchmark: bgym.Benchmark) -> str: benchmark_name = benchmark.name if hasattr(benchmark, "get_version"): return benchmark.get_version() # in...

recursix