standards icon indicating copy to clipboard operation
standards copied to clipboard

[EPIC] Migrate official compliance tests to Zuul

Open mbuechse opened this issue 1 year ago • 5 comments

PREREQUISITES:

  • [x] #660
  • [x] #715
  • [x] #716
  • [x] #664
  • [x] #665
  • [x] #738
  • [x] #750

OPTIONAL:

  • [x] #671
  • [ ] #666
  • [ ] add notification mechanism to compliance monitor (or poll by some other service)

TASKS:

  • [ ] write documentation for compliance tests via Zuul/compliance monitor
  • [ ] mark GitHub actions as obsolete
  • [ ] make sure templates in compliance monitor are up to date
  • [ ] include generated table into docs page
  • [ ] include link to generated table into README.md
  • [ ] finally close https://github.com/SovereignCloudStack/docs/issues/166

mbuechse avatar Jul 26 '24 14:07 mbuechse

Motivated by https://github.com/SovereignCloudStack/standards/pull/680#issuecomment-2268320692, are parallel checks against the same cloud coordinated in Zuul, so they don't interfere with each other?

martinmo avatar Aug 05 '24 07:08 martinmo

@martinmo We have worked with semaphores on jobs that basically share the same project and have overlapping names. This prevents jobs from running in parallel on a shared project.

Semaphore definition: https://github.com/regiocloud/e2e-tests/blob/main/.zuul.yaml#L82-L84 Semaphore use: https://github.com/regiocloud/e2e-tests/blob/main/.zuul.yaml#L107-L108

berendt avatar Aug 05 '24 07:08 berendt

@berendt Thanks for the hint! It seems we do not currently use this here, at least a quick rg --hidden semaphore through the standards repo didn't reveal anything like that.

martinmo avatar Aug 05 '24 07:08 martinmo

I don't think we have the case right now (the nightly jobs are not run in parallel as far as I can tell), but it would be good to be on the safe side nevertheless.

mbuechse avatar Aug 05 '24 08:08 mbuechse

Discussed in today's (extraordinary) meeting of SIG Std/Cert: most new features are actually not needed for the switch and can be postponed.

mbuechse avatar Aug 15 '24 13:08 mbuechse