Bump browsergym from 0.1.0rc7 to 0.2.2

[dependabot[bot]]

Bumps browsergym from 0.1.0rc7 to 0.2.2.

Release notes

Sourced from browsergym's releases.

Keyword arguments in high-level action space

browsergym-core

• minor fix: high-level action parser now properly handles keyword arguments in Python function calls (were converted to non-keyword arguments before)

browsergym-webarena

• minor fix: synced with latest webarena version (libwebarena=0.0.3), mostly typo fixes in task intents

Set-of-Marks, visibility, bbox and more!

browsergym-core

• New features

  • :tada: Set-of-Marks :tada: a new method is available to easily overlay element boxes and bid attributes on top of the screenshot, following ideas from WebVoyager and OSWorld

    from browsergym.utils.obs import overlay_som
    ...
    obs, info = env.reset()
    screenshot_with_som = overlay_som(obs["screenshot"], obs["extra_element_properties"], fontsize = 12, linewidth = 2, tag_margin = 2)
    

    

  • new high-level actions upload_file and mouse_upload_file

  • new field "extra_element_properties" in each observation. Contains a dict with bid keys, which gives the extra properties computed by browsergym for every element with a bid on the current page. Example:

    {
      "23": {
        "visibility": 0.6,  # float between 0 and 1
        "bbox": [56, 345, 12, 20],  # [x, y, width, height]
        "clickable": True,  # boolean
        "set_of_marks": False,  # boolean
    }
    

  • new set_of_marks property (computed with JS tag browsergym_set_of_marks), following WebVoyager implementation (boolean 0 or 1, whether element should be part of the set-of-marks overlay)

  • new clickable property, extracted from Chrome's DOMSnapshot's isClickable

  • new info fields "action_exec_start", "action_exec_timeout" and "action_exec_stop" after each env.step() call, useful for video editing

  • new resizeable_window parameter in BrowserEnv to switch between setting the viewport size via Chrome (previous behavior, resizeable window and viewport) or via Playwright (new default behaviour, viewport is not resizeable)

• Breaking changes

  • changed visibility tag in JS from browsergym_is_in_viewport (boolean 0 or 1) to browsergym_visibility_ratio (value between 0.0 and 1.0), extracted as the visibility extra property (see new features)
  • BrowserEnv parameters viewport (viewport size), slow_mo (pause between playwright calls) and timeout (default playwright timeout) are now provided by the task. They can still be set in the environment's constructor to override the value provided by the task, which will display a warning.
  • each task inheriting AbstractBrowserTask must now take a seed at instantiation (in constructor), instead of via the task.setup() method. This is also where each task should decide its desired browser setting by setting its attributes task.viewport, task.slow_mo and task.timeout (see point above)

• Refactors

  • bid-based high-level actions fail faster (500 ms)
  • shorter nested bids with alphabetical bids for iframes (21-53 -> a53)

... (truncated)

Commits

• f80ff73 version bump
• acc190c libwebarena version bump
• 3864036 tuple and named arguments in high-level action parser (#10)
• c636b3f v0.2.1 (#9)
• 4e9521c Merge pull request #8 from ServiceNow/pre-release
• e4b7a3f version bump
• 806be24 gitignore
• 1035aa6 remove matplotlib import
• df42aba workflow update
• 6f6b5e1 unit tests fix
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)