nodejs
Reliability reports by platforms
The reliability reports are generated by dates and can not be filtered to list what's failing on a specific platform. Would it be helpful to generate a reliability summary filtered by platforms? It can help us to find out the reliability of each platform.
Originally posted by @legendecas in https://github.com/nodejs/node/issues/56583#issuecomment-2587144066
A possible improvement is to generate JSON reliability reports so that the reports can be processed programatically and be filtered by platforms.
A reliability history by platform can provide supporting figures for us to determine if a platform is unstable.
Hey @legendecas, I would love to help with this one. Three of my PRs are stuck due to a bad CI, and it's annoying to ask the maintainer every time for a CI run. If solving this issue helps, I am ready to. I have set up the repository and run the tests; all are passing. I need to know which command I need to look at.
The report workflow is defined at https://github.com/nodejs/reliability/blob/81db301596de4717b67c8463d841665f4d8ee053/.github/workflows/reliability_report.yml#L43-L48.
The command is defined at https://github.com/nodejs/node-core-utils/blob/0bd46f4e3b173affd022d7d04a634e8fe70b9449/bin/ncu-ci.js#L466-L481.
There is a --json option available, along with --markdown (link). It can be updating the workflow in the nodejs/reliability to pick up the option --json, as it seems already been supported at https://github.com/nodejs/node-core-utils/blob/0bd46f4e3b173affd022d7d04a634e8fe70b9449/bin/ncu-ci.js#L472.