cockroach-teamcity

roachtest.kv/gracefuldraining [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17449330?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17449330?buildTab=artifacts#/kv/gracefuldraining) on master @ [82b1fda15c4616713b278c447d24b0ab5416e511](https://github.com/cockroachdb/cockroach/commits/82b1fda15c4616713b278c447d24b0ab5416e511): ``` (assertions.go:363).Fail: Error Trace: github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/kv.go:623 main/pkg/cmd/roachtest/monitor.go:115 golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78 src/runtime/asm_amd64.s:1695 Error: Received unexpected error: QPS of 1638.00 at time 2024-10-25 07:21:37.869589264 +0000 UTC m=+5488.202415917...

roachtest.kv/gracefuldraining [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17460847?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17460847?buildTab=artifacts#/kv/gracefuldraining) on master @ [7495c0390f93478bc0f961285f41cd4ec85a6a76](https://github.com/cockroachdb/cockroach/commits/7495c0390f93478bc0f961285f41cd4ec85a6a76): ``` (assertions.go:363).Fail: Error Trace: github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/kv.go:623 main/pkg/cmd/roachtest/monitor.go:115 golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78 src/runtime/asm_amd64.s:1695 Error: Received unexpected error: QPS of 1763.00 at time 2024-10-26 11:31:41.28558219 +0000 UTC m=+20427.727846316...

roachtest.kv/gracefuldraining [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17470768?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17470768?buildTab=artifacts#/kv/gracefuldraining) on master @ [1b5c41939197efb0fa50ded9795e2e83f5c1dd34](https://github.com/cockroachdb/cockroach/commits/1b5c41939197efb0fa50ded9795e2e83f5c1dd34): ``` (assertions.go:363).Fail: Error Trace: github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/kv.go:623 main/pkg/cmd/roachtest/monitor.go:115 golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78 src/runtime/asm_amd64.s:1695 Error: Received unexpected error: QPS of 1710.00 at time 2024-10-28 11:26:40.935068343 +0000 UTC m=+20191.419794430...

roachtest.kv/gracefuldraining [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17485636?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17485636?buildTab=artifacts#/kv/gracefuldraining) on master @ [615110b2b10de95d6ea25602db5dd8fdd5dbe576](https://github.com/cockroachdb/cockroach/commits/615110b2b10de95d6ea25602db5dd8fdd5dbe576): ``` (assertions.go:363).Fail: Error Trace: pkg/cmd/roachtest/tests/kv.go:632 pkg/cmd/roachtest/monitor.go:115 external/org_golang_x_sync/errgroup/errgroup.go:78 src/runtime/asm_amd64.s:1695 Error: Received unexpected error: QPS of 1747.00 at time 2024-10-29 06:49:00.164557962 +0000 UTC m=+3926.266283178...

**Note:** This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there...

roachtest.kv/gracefuldraining [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17523448?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17523448?buildTab=artifacts#/kv/gracefuldraining) on master @ [becbd0fcdfa2e37a6ff23b33af70f2f91eca0790](https://github.com/cockroachdb/cockroach/commits/becbd0fcdfa2e37a6ff23b33af70f2f91eca0790): ``` (assertions.go:363).Fail: Error Trace: pkg/cmd/roachtest/tests/kv.go:632 pkg/cmd/roachtest/monitor.go:115 external/org_golang_x_sync/errgroup/errgroup.go:78 src/runtime/asm_amd64.s:1695 Error: Received unexpected error: QPS of 645.00 at time 2024-10-31 07:08:37.894839281 +0000 UTC m=+5609.756790770...

sql.TestTenantGlobalAggregatedLivebytes [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/17389749?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/17389749?buildTab=artifacts#/) on release-24.3 @ [b2d2353b876af1748607e155ecdfed9d4bba29d3](https://github.com/cockroachdb/cockroach/commits/b2d2353b876af1748607e155ecdfed9d4bba29d3): ``` github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).recover(0x4013683948?, {0x82d4560, 0x40122a3a70}) github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:226 +0x68 panic({0x5dffd00?, 0xc1e3390?}) GOROOT/src/runtime/panic.go:770 +0x124 github.com/cockroachdb/cockroach/pkg/util/admission.(*SnapshotQueue).Admit(0x0, {0x82d4560, 0x400f6841e0}, 0x10a4) github.com/cockroachdb/cockroach/pkg/util/admission/snapshot_queue.go:165 +0x4c github.com/cockroachdb/cockroach/pkg/util/admission.(*SnapshotPacer).Pace(0x4013684740, {0x82d4560?, 0x400f6841e0?}, 0x40027fb5b3?, 0x5?) github.com/cockroachdb/cockroach/pkg/util/admission/snapshot_queue.go:292...

sql.TestTenantGlobalAggregatedLivebytes [failed](https://tanzanite.cluster.engflow.com/invocations/default/1fd6a8ae-5267-4a61-a9f3-88a3d0b39872?testReportRun=5&testReportShard=11&testReportAttempt=1#targets-Ly9wa2cvc3FsOnNxbF90ZXN0) on release-24.3 @ [b2d2353b876af1748607e155ecdfed9d4bba29d3](https://github.com/cockroachdb/cockroach/commits/b2d2353b876af1748607e155ecdfed9d4bba29d3): Fatal error: ``` panic: runtime error: invalid memory address or nil pointer dereference [recovered] panic: runtime error: invalid memory address or nil pointer dereference...

roachtest.schemachange/mixed-versions-compat [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17296484?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17296484?buildTab=artifacts#/schemachange/mixed-versions-compat) on master @ [30dbb173d0f083b35cf9eb8093832a5dd764c5af](https://github.com/cockroachdb/cockroach/commits/30dbb173d0f083b35cf9eb8093832a5dd764c5af): ``` runtime.goexit({}) src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0009b6fe8 sp=0xc0009b6fe0 pc=0x4dd321 created by github.com/cockroachdb/cockroach/pkg/util/log.init.5 in goroutine 1 github.com/cockroachdb/cockroach/pkg/util/log/log_flush.go:79 +0x26 goroutine 21 gp=0xc0014f1880 m=nil [select, locked to...

roachtest.schemachange/mixed-versions-compat [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17305037?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/17305037?buildTab=artifacts#/schemachange/mixed-versions-compat) on master @ [a0f39e7ac9574756063bc90bba6bc532b45c33d4](https://github.com/cockroachdb/cockroach/commits/a0f39e7ac9574756063bc90bba6bc532b45c33d4): ``` runtime.goexit({}) src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0013b57e8 sp=0xc0013b57e0 pc=0x4dd321 created by github.com/cockroachdb/cockroach/pkg/util/log.init.5 in goroutine 1 github.com/cockroachdb/cockroach/pkg/util/log/log_flush.go:79 +0x26 goroutine 34 gp=0xc001004000 m=nil [select, locked to...