cockroach icon indicating copy to clipboard operation
cockroach copied to clipboard

roachtest,asim: validate asim

Open kvoli opened this issue 3 years ago • 1 comments
trafficstars

This patch adds a roachtest to validate the accuracy of the allocation simulator. It collects results of running identical configurations in simulated and real cluster.

The collected results are then compared, looking at the similarity of distributions for per-store metrics:

  • lease count
  • replica count
  • queries per second
  • write keys
  • read keys
  • write bytes
  • read bytes

And comparing cluster metrics:

  • range rebalance count
  • lease transfer count
  • rebalancing snapshot bytes

The roachtest will fail, without blocking the release if any of these measurements are different, beyond an error threshold.

Release note: None

kvoli avatar Sep 16 '22 20:09 kvoli

This change is Reviewable

cockroach-teamcity avatar Sep 16 '22 20:09 cockroach-teamcity