gateway-api icon indicating copy to clipboard operation
gateway-api copied to clipboard

Conformance: Add option to run tests against experimental CRDs

Open robscott opened this issue 3 years ago • 2 comments

With the recent v0.5.0 release, some conformance tests now depend on a resource that is only available in the experimental channel (ReferenceGrant). To improve this experience we should:

  1. Add a new "MinChannel" string option to Suite that defaults to "standard"
  2. Add a new "MinChannel" option to ConformanceTest - I don't think we should have a default here
  3. Update all conformance tests to specify MinChannel: Standard unless they include ReferenceGrant
  4. Add logic to conformanceTest.Run() that skips tests where test.minChannel < suite.minChannel

robscott avatar Jul 19 '22 23:07 robscott

/assign @paulohgontijoo

paulohgontijoo avatar Jul 26 '22 18:07 paulohgontijoo

One addition to the set of tests that should be covered here: "HTTPRouteDisallowedKind" relies on some level of TLSRoute support which is currently only available in experimental channel.

robscott avatar Aug 11 '22 21:08 robscott