Export report dialog with Magnifier shifts when typing

[ferBonnin]

Describe the bug

When using magnifier, the export report dialog moves unexpectedly when typing (specially if deleting text)

To Reproduce Steps to reproduce the behavior:

Open Magnifier

1. Run automated checks in an Android app
2. select export report button
3. type some text and delete some text notice how the text box moves when typing and moves erratically when deleting text.

Expected behavior

the text box should not move erratically.

Context (please complete the following information)

• OS Name & Version: Windows
• AI-Web Version & Environment: Android

Additional context

From Peter, looking at the text-shifting video it seems like Magnifier is toggling between centering on the text cursor and centering on the mouse pointer. Not clear, but possible, that there's behavior on our part that is triggering this.

[ghost]

This issue has been marked as ready for team triage; we will triage it in our weekly review and update the issue. Thank you for contributing to Accessibility Insights!

[ghost]

This issue requires additional investigation by the Accessibility Insights team. When the issue is ready to be triaged again, we will update the issue with the investigation result and add "status: ready for triage". Thank you for contributing to Accessibility Insights!

[karanbirsingh]

@ferBonnin I tried running Magnifier on notepad.exe, a native input element in Edge / Chrome, and Accessibility Insights. For me all experiences kept the text cursor in the center, so each character change moved the border. I wonder if this is expected behavior or if you had a different experience.

[ghost]

The team requires additional author feedback; please review their replies and update this issue accordingly. Thank you for contributing to Accessibility Insights!

[ferBonnin]

sent link to two videos to @karanbirsingh. Can only reproduce in Unified. display resolution: 1920 x 1080 with 150% zoom magnifier settings: 300% with smoot edges of images and text, and have magnifier follow all checked program placement: app in full screen in the second monitor win version: Win 10 Enterprise 20H2

[ghost]

This issue requires additional investigation by the Accessibility Insights team. When the issue is ready to be triaged again, we will update the issue with the investigation result and add "status: ready for triage". Thank you for contributing to Accessibility Insights!

[karanbirsingh]

I am able to reproduce this with a minimal electron application with a simple textarea. It can be downloaded here.

When Magnifier zooms in such that the textarea exceeds the size of the screen, typing leads to 'jumping' behavior where the Magnifier bounds alternate between centering on the text cursor and what seems like the full textarea. For me this occurs with a single-monitor setup at 1920x1080 at 150% resolution, with 300% magnifier zoom.

see video here

[ferBonnin]

thanks @karanbirsingh! taking this out of the board and keeping it as needs investigation to follow up.

[karanbirsingh]

Updating with smaller video showing Magnifier "jumping" behavior:

https://user-images.githubusercontent.com/7775527/102809566-122c6280-4377-11eb-9e29-8b5ee9ef1162.mp4

So far it seems the root cause is "extra" Focus events raised by textareas in Electron. Magnifier reacts to the intermittent events and the viewport shifts.

Here are event recording logs:

UIA:FocusEvent Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""
UIA:AutomationEvent    [Text_TextChanged] Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""
UIA:AutomationEvent              [Text_TextSelectionChanged] Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""
UIA:AutomationEvent    [Text_TextChanged] Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""
UIA:FocusEvent Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""
UIA:AutomationEvent    [Text_TextChanged] Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""
UIA:AutomationEvent              [Text_TextSelectionChanged] Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""
UIA:AutomationEvent    [Text_TextChanged] Sender: ControlType:UIA_EditControlTypeId (0xC354), Name:""

In the Chrome or Edge browsers, extra focus events are not raised when typing in a textarea, and the viewport stays steady. Seeing if this is something that is better handled in Magnifier or if there's an issue in Electron's event-raising

[karanbirsingh]

This is blocked on https://github.com/electron/electron/issues/27826

[DaveTryon]

We won't be fixing this