swift-snapshot-testing
swift-snapshot-testing copied to clipboard
pointfreeco
Diff Image is empty
We implemented successfully snapshot tests for critical scenarios using XCUITests and snapshots. When I run locally using Fastlane or Xcode. it is working fine. Currently, all tests are failing on builds machining We are not able to see any diff change in diff image. I have set a 0.985 match. and I also tested 1 match locally and works fine as well.
- Builds machines and local simulators are same (iPhone 11 Pro) iOS 13.3
- We also override status bars to keep time, network, and batteries. That's keep everything same for all snapshot
Have you tried using https://kaleidoscope.app in order to compare your diffs ?
This SnapshotTesting.diffTool = "ksdiff" will simplify using kaleidoscope.app for the diff process.
Yes, I am using SnapshotTesting.diffTool = "ksdiff" that I am calling from functions. Still failing
I also check both images on https://online-image-comparison.com and seem valid. I haven't seen any diff
When I do .wait(for: timeout, on: .image(precision: 0.80)), then only it pass
Have you tried to change the output and not use image but something like recursive description for exemple ?
@jambudi It's not empty actually. You can check this by downloading diff image and using adjust color feature in mac os x preview.
@jambudi Were you able to figure out the problem or are you able to provide more info?
@stephencelis No, We were not able to fix it. I reduce the percentage match to 0.85
I can provide more information. Let me know what exactly you need. @stephencelis
@ShurupuS big 👍, I am uploading the color settings that worked for me after hitting Auto Levels button:
