Script Output in CheckRun.output.text if submitted via PR

[nnordrum]

Prerequisites:

• Is the functionality available in the GitHub UI? If so, please provide a link to information about the feature. No

• Is the functionality available through the GitHub API? If the functionality is available, please provide links to the API documentation (https://developer.github.com/v3/) as well as the Octokit documentation (https://octokit.github.io/). No
• If the functionality is not yet available in the API, it would be helpful if you contacted support (https://support.github.com/) or posted in the Community Forum (https://github.community/). Please include a link to the forum post if you create one or a copy of the response from support.

New Feature

Please describe the desired new functionality:

If you're not the one running Settings (e.g. you have a corporate instance responsible for lots of orgs), the errors/output go into a black hole (unless you pipe the logs to splunk or similar and share access to them). It would be nice if when the Settings were processed, if they came from a PR, the output was put in a CheckRun.output.text, or even just an error message if one is received while processing. There shouldn't be any security issues as people who can see the CheckRun.output.text can also see the .github/settings.yml file. Regardless, you can put creating the CheckRun.output.text behind a feature flag if there's some SaaS security concern I'm not aware of.

[nnordrum]

GitHub Pages appears to send you an email if there's an issue; that would be a good option too (obviously more configuration)