cockroach icon indicating copy to clipboard operation
cockroach copied to clipboard

roachtest: follower-reads/mixed-version/single-region failed

Open cockroach-teamcity opened this issue 1 year ago • 0 comments

roachtest.follower-reads/mixed-version/single-region failed with artifacts on release-24.3 @ 4cbedefd790c75cb0f21f77ed8d917c8528a7d15:

(follower_reads.go:870).verifyHighFollowerReadRatios: too many intervals with more than 2 nodes with low follower read ratios: 23 intervals > 4 threshold. Bad intervals:
interval 14:25:30-14:25:40: n1 ratio: 0.000 n2 ratio: 0.298 n3 ratio: 0.000 n4 ratio: 0.000 
interval 14:25:40-14:25:50: n1 ratio: 0.000 n2 ratio: 1.546 n3 ratio: 0.000 n4 ratio: 0.000 
interval 14:25:50-14:26:00: n1 ratio: 0.001 n2 ratio: 2.139 n3 ratio: 0.000 n4 ratio: 0.014 
interval 14:26:00-14:26:10: n1 ratio: 0.002 n2 ratio: 2.023 n3 ratio: 0.000 n4 ratio: 0.004 
interval 14:26:10-14:26:20: n1 ratio: 0.000 n2 ratio: 1.241 n3 ratio: 0.000 n4 ratio: 0.000 
interval 14:26:20-14:26:30: n1 ratio: 0.000 n2 ratio: 1.279 n3 ratio: 0.694 n4 ratio: 0.000 
interval 14:26:30-14:26:40: n1 ratio: 0.000 n2 ratio: 1.490 n3 ratio: 0.264 n4 ratio: 0.000 
interval 14:26:40-14:26:50: n1 ratio: 0.000 n2 ratio: 1.726 n3 ratio: 0.000 n4 ratio: 0.000 
interval 14:26:50-14:27:00: n1 ratio: 0.000 n2 ratio: 1.269 n3 ratio: 0.378 n4 ratio: 0.000 
interval 14:27:00-14:27:10: n1 ratio: 0.000 n2 ratio: 0.316 n3 ratio: 0.990 n4 ratio: 0.000 
interval 14:27:10-14:27:20: n1 ratio: 0.000 n2 ratio: 0.932 n3 ratio: 0.424 n4 ratio: 0.000 
interval 14:27:20-14:27:30: n1 ratio: 0.000 n2 ratio: 1.300 n3 ratio: 0.353 n4 ratio: 0.000 
interval 14:27:30-14:27:40: n1 ratio: 0.000 n2 ratio: 1.437 n3 ratio: 0.558 n4 ratio: 0.000 
interval 14:27:40-14:27:50: n1 ratio: 0.000 n2 ratio: 0.819 n3 ratio: 0.623 n4 ratio: 0.000 
interval 14:28:00-14:28:10: n1 ratio: 0.000 n2 ratio: 1.176 n3 ratio: 0.807 n4 ratio: 0.000 
interval 14:28:10-14:28:20: n1 ratio: 0.000 n2 ratio: 1.738 n3 ratio: 0.000 n4 ratio: 0.000 
interval 14:28:20-14:28:30: n1 ratio: 0.000 n2 ratio: 1.810 n3 ratio: 0.069 n4 ratio: 0.000 
interval 14:28:30-14:28:40: n1 ratio: 0.000 n2 ratio: 0.875 n3 ratio: 0.879 n4 ratio: 0.000 
interval 14:28:40-14:28:50: n1 ratio: 0.000 n2 ratio: 2.000 n3 ratio: 0.003 n4 ratio: 0.000 
interval 14:28:50-14:29:00: n1 ratio: 0.000 n2 ratio: 1.988 n3 ratio: 0.000 n4 ratio: 0.000 
interval 14:29:00-14:29:10: n1 ratio: 0.000 n2 ratio: 1.872 n3 ratio: 0.042 n4 ratio: 0.000 
interval 14:29:10-14:29:20: n1 ratio: 0.000 n2 ratio: 1.441 n3 ratio: 0.512 n4 ratio: 0.000 
interval 14:29:20-14:29:30: n1 ratio: 0.000 n2 ratio: 1.559 n3 ratio: 0.315 n4 ratio: 0.000 
(mixedversion.go:732).Run: panic (stack trace above): t.Fatal() was called
test artifacts and logs in: /artifacts/follower-reads/mixed-version/single-region/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=2
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

  • #129546 roachtest: follower-reads/mixed-version/single-region failed [C-bug C-test-failure O-roachtest O-robot P-2 T-kv branch-master]
/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-43397

cockroach-teamcity avatar Oct 19 '24 14:10 cockroach-teamcity