Pop-up windows and Combobox can not be viewed

[taogoddd]

Dear authors,

Thanks for your nice work and quick follow-ups for issues. I found two problems when using the benchmark, especially on the map website:

1. The pop-up windows, e.g., the error reporting window popping up in the following screenshot, can not be viewed through the accessibility tree/HTML/screenshot through Playwright. I found this when the agent tried to type a wrong query into the "From" box following with pressing enter but the observation (neither the screenshot nor the accessibility tree) after this action does not show any thing about the pop-up window.

2. The options in the combobox can not be viewed through the accessibility tree. One example is as follows: In this screenshot, the combobox with content "Car (OSRM)" has been clicked and expanded with the options visible. But the accessibility tree around it is like this: [736] textbox 'From' required: False [773] StaticText 'Randyland, 1501, Arch Street, Central Northside, Pittsburgh, Allegheny County, 15212, United States' [729] textbox 'To' required: False [927] StaticText 'Carnegie Mellon University, Schenley Drive Extension, North Oakland, Pittsburgh, Allegheny County, 15213, United States' [742] combobox '' focused: True hasPopup: menu expanded: True [727] button 'Go' [728] button 'Reverse Directions' [844] heading 'Directions' [847] button 'Close' where the options are not in the tree. I am not sure whether this is the problem/defect of the accessibility tree itself or not.

These two problems seem trivial but influence the performance of an agent a lot since many tasks in map will involve these.

I would appreciate it if these questions could be discussed and answered further. Please let me know if there are any problems with my description here. Thank you in advance for your attention and participation.