Austen

Duplicate of #125170.

Most recent failure cc @sumeerbhola: ``` === RUN TestFlowControlRaftSnapshotV2/v2_enabled_when_leader_level=2/kvadmission.flow_control.mode=apply_to_all POTENTIAL DEADLOCK: Inconsistent locking. saw this ordering in one goroutine: happened before github.com/cockroachdb/cockroach/pkg/kv/kvserver/kvflowcontrol/rac2/range_controller.go:2117 rac2.(*replicaState).handleReadyEntries ???

The cause is a send queue forming shortly after n3 receives a snapshot, then immediately disappearing. ``` I241018 14:59:17.713487 48217 kv/kvserver/replica_raftstorage.go:521 ⋮ [T1,Vsystem,n3,s3,r70/3:‹/{Table/Max-Max}›] 3793 applied snapshot f06c9078 from (n1,s1):1 at...

The latency is reflected in the workload logs as well, 25s after restarting n6, after stopping n6 once. ``` # (07:20:28) 151.0s 0 504.8 496.0 1.4 1.9 3.1 13.1 follower-read...

Ah looks like 0 wasn't valid for the profiling interval. Opened https://github.com/cockroachdb/cockroach/pull/131760. I'll try a run myself and see what happens as well.

I'm going to remove my assignment -- as this involvement was primarily triage related. If the test fails again with the CPU profiles available, I'll take a look.

Details ``` W241011 21:16:35.037327 11756 kv/kvserver/intentresolver/intent_resolver.go:1033 ⋮ [T1,Vsystem,n1,s1,r1/1:‹/{Min-System/NodeL…}›] 850 test-only warning: if you see this, please report to https://github.com/cockroachdb/cockroach/issues/112680. empty admission header provided by ‹goroutine 11756 [running]:› W241011 21:16:35.037327 11756...

TYFTR bors r=sumeerbhola

TYFTR! bors r=andrewbaptist,arulajmani

TYFTR! rebased.