Add test reporting to detect flaky tests over time

[msfstef]

We need some tooling that will keep track of what tests are flaky so we can focus on making our suites rock solid.