midscene icon indicating copy to clipboard operation
midscene copied to clipboard

Issue with Layout Analysis: Unable to Analyze Elements Inside iframe

Open jcljcljcl opened this issue 11 months ago • 2 comments

I noticed that when a page contains iframe elements, the tool is unable to analyze or recognize the elements inside the iframe.

jcljcljcl avatar Jan 07 '25 11:01 jcljcljcl

Hi @jcljcljcl , this is a known limitation of Midscene. We are still finding ways to solve it.

yuyutaotao avatar Jan 07 '25 12:01 yuyutaotao

Hi @jcljcljcl , this is a known limitation of Midscene. We are still finding ways to solve it.

may I ask what is causing the current bottleneck? Is it a limitation of the browser itself?

jcljcljcl avatar Jan 07 '25 12:01 jcljcljcl

It is very difficult to execute JavaScripts in a cross-origin iframe.

We will solve the same-origin iframe in this PR: https://github.com/web-infra-dev/midscene/pull/258

As to the cross-origin ones, let's wait for other approaches.

yuyutaotao avatar Jan 09 '25 06:01 yuyutaotao

Hi @jcljcljcl, since version 0.10.1, you can extract the contents inside the same-origin iframe. The Chrome extension will be released in the next few days.

yuyutaotao avatar Jan 23 '25 07:01 yuyutaotao

thank you, i will give it a try

---Original--- From: @.> Date: Thu, Jan 23, 2025 15:43 PM To: @.>; Cc: @.@.>; Subject: Re: [web-infra-dev/midscene] Issue with Layout Analysis: Unable toAnalyze Elements Inside iframe (Issue #256)

Hi @jcljcljcl, since version 0.10.1, you can extract the contents inside the same-origin iframe. The Chrome extension will be released in the next few days.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

jcljcljcl avatar Jan 23 '25 07:01 jcljcljcl

Hi @jcljcljcl, since version 0.10.1, you can extract the contents inside the same-origin iframe. The Chrome extension will be released in the next few days.

hey still not working for me like when trying to dismiss the "stay signed out" iframe popup on google.com

rublev avatar Mar 25 '25 04:03 rublev