Introduce reporting methods

[mimir-d]

Issue by insomniacslk Thursday Feb 06, 2020 at 14:11 GMT Originally opened as https://github.com/facebookincubator/contest/issues/33

---

Currently every reporter is responsible for result calculation and delivery of the report. However some tasks are common to many reporters (e.g. sending results over e-mail), and it would be easier on the user if they were supported out of the box. I propose to add a Methods section in the reporters that will allow to specify multiple ways of delivering a report.

This should send the JSON report via the specified methods, and also allow (optional) filtering and templating so users can format the report as desired.

    "Reporting": {
        "RunReporters": [
            {
                "Name": "TargetSuccess",
                "Parameters": {
                    "SuccessExpression": ">80%"
                },
                "Methods": [
                    {
                        "name": "email",
                        "recipient": "[email protected]"
                    }
                }
            ]
        ],
        ...
    }