equal-access icon indicating copy to clipboard operation
equal-access copied to clipboard

[BUG] Node.js version of `getCompliance(html, 'my-label')` does not mark violation `ignored: true` in newly generated report file

Open liunate opened this issue 3 years ago • 1 comments

Node.js version of accessibility checker running in Jest.

Steps and test to reproduce this at jest without specifying any config:

  const { report: actual } = await aChecker.getCompliance(
    '<html><header></header><body><div>123</div></body></html>',
    'nate'
  );

  const assertActual = aChecker.assertCompliance(actual);

  expect(assertActual).toBe(0);
  1. Run attached test
  2. Run assertCompliance(report) it returns 2 (this is the expected behavior as we don't have any baseline yet)
  3. Copy the results file /results/nate.json to /baselines/nate.json
  4. Run attached test again
  5. New /results/nate.json still has all its violations ignored: false and summary.count.ignored: 0 (expecting true and ignored bumped but it doesn't happen)
  6. Run assertCompliance(report) it returns 0 (expected behavior as new scan find out exactly same violations as baseline)

liunate avatar May 04 '22 03:05 liunate

triage: doesn't match the baseline, bug in automated tool (nodeJs)

shunguoy avatar May 24 '22 15:05 shunguoy

Fixed, will show up in next release.

tombrunet avatar May 24 '23 16:05 tombrunet