maestro icon indicating copy to clipboard operation
maestro copied to clipboard

[1.33.1 and 1.34.1] Commands with unfound elements are not failing

Open maximgeerinck opened this issue 6 months ago • 1 comments

Describe the bug

It seems like commands always return OK

To Reproduce Steps to reproduce the behavior, e.g.:

  1. Start the simulator
  2. Run maestro studio
  3. Run the command:
tapOn: IDKANYMORE

or

assertVisible:
  text: HAHAHAHAFUFUEWHFIUFEHIUEWHFEIUWHGUWEHIGEWUIHGEWIUH

and it marked it as Correct

Expected behavior

It should fail the test

Screenshots

Screenshot 2023-12-11 at 08 40 05

Environment information (please complete the following information):

  • Maestro version 1.33.1
  • Platform:IOS
  • Framework: React Native
  • Device model and OS version: iPhone 15 Pro Max
  • Simulator, emulator or physical device: Simulator (but also on CI in maestro cloud)
  • Host [e.g. Mac M1, Windows, Linux, etc]: Mac M2

Additional Info

  • Commented out my .maestro/config.yaml file as well to test

maximgeerinck avatar Dec 11 '23 07:12 maximgeerinck

Same thing on v1.36.0, every command run in studio completes successfully, even with id and/or text selectors that do not exist. When run with test they fail as they should.

rob4226 avatar Mar 16 '24 14:03 rob4226