Fails to interact with elements within a scaled frame

[christian-bromann]

Given a user defines a frame via:

<div style="transform: scale(0.5); transform-origin: top left; margin: 1rem; width: 400px; height: 400px; border: 1px solid black">
  <iframe id="scaled" src="./other.html?scaled" style="width: 100%; height: 100%; border: 0"></iframe>
</div>

Interactions with elements within that frame fail, e.g. don't happen. I assume it is because the driver fails to properly calculate the coordinates. Please find a great reproducible example here: https://github.com/hi-ogawa/reproductions/tree/main/webdriverio-css-transform created by a WebdriverIO community member.

see also https://github.com/webdriverio/webdriverio/issues/13724

[whimboo]

I thought that we already had such an issue filed but I cannot find one.

See https://github.com/w3c/webdriver-bidi/issues/787 as well for WebDriver BiDi.

[OrKoN]

I think it is the same issue as was reported here https://crbug.com/42321690 years ago. I am not sure if https://github.com/w3c/webdriver-bidi/issues/787 is exactly the same. I have tested a bit and getClientRects seems to returned transformed rects in general but not for elements within scaled iframes. But I think this issue would potentially affect WebDriver BiDi as well.

[gsnedders]

I thought that we already had such an issue filed but I cannot find one.

I wrote some tests for this a bunch of months earlier in https://github.com/web-platform-tests/wpt/pull/44205 and https://github.com/web-platform-tests/wpt/pull/44473; I think I ultimately convinced myself the spec is correct here, and this is just implementation bugs?