citgm icon indicating copy to clipboard operation
citgm copied to clipboard

Proposal - Cleanup the modules failing often

Open RafaelGSS opened this issue 2 years ago • 8 comments

When performing a release, we usually compare the citgm run against the previous CI. This, however, does hide modules that are failing often. Instead of comparing 100 failures with 101 failures and proceeding with the release, we should lower this number the much as we can, otherwise, the citgm will become meanless.

I think we should:

  • When the package fails frequently, ping the module author.
  • Drop the package from lookup.json when no response from the "maintainer"

This should help the releasers a lot (plus reducing the citgm time).

cc: @nodejs/releasers

RafaelGSS avatar Jul 04 '23 19:07 RafaelGSS

Isn't it the purpose of the "maintainers" field?

targos avatar Jul 04 '23 20:07 targos

Oh, yeah. My bad. Let me adjust the proposal to cover the second part only.

RafaelGSS avatar Jul 04 '23 22:07 RafaelGSS

When the package fails frequently, ping the module author.

If this is going to block releases, it may be worth collecting alternative contact information, since GitHub notifications can be overwhelming (and thus ignored or dealt with in delayed batches) by some folks.

bengl avatar Jul 05 '23 16:07 bengl

+1 to the suggestion.

mhdawson avatar Jul 14 '23 16:07 mhdawson

Adding Release-agenda to mention it in the next meeting so we can move it forward

RafaelGSS avatar Aug 02 '23 03:08 RafaelGSS

Since the CITGM has been red for years, maybe a better approach would be just starting from a clean slate, and gradually add modules back while strictly keeping it green. A red CI in the normally green CI is much more noticable, and I feel the approach of trying to remove modules until it's green had not been working well for a long time until this day...

joyeecheung avatar Sep 07 '23 14:09 joyeecheung

Ref #959

RafaelGSS avatar Sep 10 '23 13:09 RafaelGSS

We discussed this in the WG meeting today. Suggestion is that someone opens a pull request documenting the procedure. Once the PR is accepted and merged, we can close this.

targos avatar Nov 16 '23 16:11 targos

I'm closing it as concluded as the first step has been concluded #958 #929 https://github.com/nodejs/citgm/pull/1035

RafaelGSS avatar Mar 25 '24 16:03 RafaelGSS