Move test reporting (slack/pagerduty) to client

[noahnu]

Test reporting should happen in the client. This simplifies the service, lets us remove dependencies from the service, and ensures we're not limited by the information we have in the service. Moving the reporting to the client also lets us aggregate reports if we want to.

Marked as a breaking change, but there might a way to roll this out without a breaking change.