maestro icon indicating copy to clipboard operation
maestro copied to clipboard

[v1.33.1] assertVisible is producing false positives in Maestro Studio

Open clmoore28 opened this issue 2 years ago • 4 comments

Describe the bug Maestro Studio is not failing the assertVisible assertions when the elements do not exist.

To Reproduce

  1. Start the simulator for a React Native project on iOS or Android
  2. Run Maestro Studio
  3. Manually run an assertVisible assertion in the commands box for any ID that does not exist

Expected behavior The command fails.

Screenshots image

Environment information (please complete the following information):

  • Maestro version v1.33.1
  • Platform: iOS v17.0 & Android v13, but possibly across others.
  • Framework: React Native
  • Device model and OS version: All iPhone emulators and Android devices.
  • Simulator, emulator or physical device: Simulators/emulators and physical devices.
  • Host [e.g. Mac M1, Windows, Linux, etc]: Mac M1

clmoore28 avatar Oct 17 '23 10:10 clmoore28

It is affecting me too

hackgoofer avatar Nov 19 '23 02:11 hackgoofer

Any assertVisible or assertNotVisible seems to "pass" in Studio

rikur avatar Dec 28 '23 06:12 rikur

Still happening in v1.36.0, it seems every command succeeds in studio when it should really fail.

Related issue #1617.

rob4226 avatar Mar 16 '24 14:03 rob4226