CommonFormatters Behat extension

An aggregation of extra formatters for Behat supposed to be used commonly.

Installation

See https://github.com/Behat/CommonFormatters/blob/master/doc/index.rst

Formatters that distinguish between an error and a failure in terms of xUnit's notion

See https://github.com/Behat/Behat/issues/111

• A failed step is the equivalent of an error in xUnit.
• A false step is the equivalent of a failure in xUnit (colored magenta by the formatters).
• Actually a false step is a failed step too, it is just a fine-grained interpretation of a failed step (complementarily there can be non-false steps among failed steps).

ProgressWithFalseStepsFormatter

https://github.com/Behat/CommonFormatters/blob/master/src/Behat/CommonFormatters/ProgressWithFalseStepsFormatter.php

PrettyWithFalseStepsFormatter

https://github.com/Behat/CommonFormatters/blob/master/src/Behat/CommonFormatters/PrettyWithFalseStepsFormatter.php

HtmlWithFalseStepsFormatter

https://github.com/Behat/CommonFormatters/blob/master/src/Behat/CommonFormatters/HtmlWithFalseStepsFormatter.php

Formatter that dumps the most important information about a suite run as JSON

JsonFormatter

https://github.com/Behat/CommonFormatters/blob/master/src/Behat/CommonFormatters/JsonFormatter.php

{
  date: "2012-11-20: 14:55:31",
  features: [
    {
      "title": "A feature",
      "desc": null,
      "tags": [
        "foo"
      ],
      "result": "passed",
      "scenarios": [
        {
          "title": "A scenario",
          "isOutline": false,
          "tags": [
            "bar"
          ],
          "result": "passed",
          "steps": [
            {
              "text": "some precondition",
              "type": "Given",
              "isBackground": false,
              "result": "passed"
            },
            {
              "text": "some action",
              "type": "When",
              "isBackground": false,
              "result": "passed"
            },
            {
              "text": "some outcome",
              "type": "Then",
              "isBackground": false,
              "result": "passed"
            }
          ]
        }
      ]
    }
  ]
}

Formatter that adds a new line to a CSV file for each suite run

CsvStatisticsFormatter

https://github.com/Behat/CommonFormatters/blob/master/src/Behat/CommonFormatters/CsvStatisticsFormatter.php

execution date,total execution time,number of features,number of features with failures,number of scenarios,number of scenarios with failures,number of steps,number of failed steps
Fri 30 Mar 2012 11:36:57,2m44.987s,2,1,39,2,155,2