wdio-visual-regression-service icon indicating copy to clipboard operation
wdio-visual-regression-service copied to clipboard

Ability to fail test when there is no reference image

Open mgibas opened this issue 6 years ago • 2 comments

I would like to fail a test when there is no reference image. My use case looks like that:

  • run tests on local machine (generates reference images)
  • inspect local images
  • commit, push
  • run tests on CI (generates images for different browsers, OS)
  • download images and inspect
  • commit and push downloaded images as reference

there is possibility though that someone will forget some files or these steps so It would be nice to have an option to fail test run that doesn't have reference images and they need to be copied over from taken to referene manually to make next run green.

mgibas avatar Apr 17 '18 11:04 mgibas

Letting the tests fail is out of responsibility of this service. But we could provide the required information for this into the result reports, so you can assert it by yourself.

Implementation should be simple when #78 is merged.

zinserjan avatar May 10 '18 07:05 zinserjan

That seems like a fair solution :+1:

mgibas avatar May 10 '18 08:05 mgibas