modernweb-dev
Ability to provide pixelmatch config per snapshot
I find that some snapshots fail by a small percentage while others never do. It would be nice to be able to specify a threshold only for specific visualDiff() calls.
If you had a theoretical path towards making this possible, we'd certainly discuss it. However, I've found that some browsers just won't give up sometimes displaying pixels incorrectly and my project is better off making use of retries than trying to configure the work at that level of granularity.
In my project, I have a failureThreshold: 1.25, config so that my tests pass on CI and and locally. The problem is that I could set the failureThreshold much lower on Chrome without any issue. I have to set it this high to work around Safari display differences that I can't fix.
If you're running into the difference at a browser level, have you tried running the tests separately for each browser with a different config file?
You should be able to share all of the base configuration and then only override the browser configs in that case.
Having two configurations will cause problems when I want certain features, such as coverage. + It's cumbersome :(
It may be cool a feature such as failureThreshold supports (browser: string) => boolean.