FluidFramework icon indicating copy to clipboard operation
FluidFramework copied to clipboard

improvement(test-version-utils): Update cross-client compat matrix

Open scottn12 opened this issue 5 months ago • 0 comments

Description

This PR updates our cross-client compat generation matrix to include N-1 and N-2. This is done to align with our new cross-client compat policy.

Updated Matrix

With these changes, we test the current version (N) against the following releases:

  • N-1 and N-2, for legacy+alpha breaking minor releases (i.e. >=2.10.0 <2.20.0, >=2.20.0 <2.30.0, etc.)
  • N-1 and N-2, for public major releases (i.e. ^1.0.0, ^2.0.0, etc.)
  • LTS versions

The following is an example output for a test using "FullCompat" with these changes. Please note:

  • N = 2.43.0
  • N-1 (legacy+alpha minor release) = 2.33.2
  • N-2 (legacy+alpha minor release) = 2.23.0
  • N-1 (public major release) = 1.4.0
  • N-2 (public major release) = Excluded since it is less than 1.0.0 (our policy only supports releases >=1.0.0)
  • N-1 (LTS) = Excluded since it is a duplicate release (1.4.0)

Non-Compat
  ✔ Example Test
compat 2.33.2 (N-1) - old loader
  ✔ Example Test
compat 2.33.2 (N-1) - new loader
  ✔ Example Test
compat 2.33.2 (N-1) - old driver
  ✔ Example Test
compat 2.33.2 (N-1) - new driver
  ✔ Example Test
compat 2.33.2 (N-1) - old container runtime
  ✔ Example Test
compat 2.33.2 (N-1) - new container runtime
  ✔ Example Test
compat 2.33.2 (N-1) - old data runtime
  ✔ Example Test
compat 2.33.2 (N-1) - new data runtime
  ✔ Example Test
compat LTS 1.4.0 - old loader
  ✔ Example Test
compat LTS 1.4.0 - old loader + old driver
  ✔ Example Test
compat cross-client - create with 2.43.0 + load with 2.33.2
  ✔ Example Test
compat cross-client - create with 2.43.0 + load with 2.23.0
  ✔ Example Test
compat cross-client - create with 2.43.0 + load with 1.4.0
  ✔ Example Test
compat cross-client - create with 2.33.2 + load with 2.43.0
  ✔ Example Test
compat cross-client - create with 2.23.0 + load with 2.43.0
  ✔ Example Test
compat cross-client - create with 1.4.0 + load with 2.43.0
  ✔ Example Test

Misc

AB#38596

scottn12 avatar Jun 10 '25 19:06 scottn12