[v24.1.x] Keep producer inflight requests queue bounded
Backport of PR https://github.com/redpanda-data/redpanda/pull/23692
the below tests from https://buildkite.com/redpanda/redpanda/builds/56333#01927aa3-fcbc-48a3-acff-052bbd99d73a have failed and will be retried
gtest_raft_rpunit
partition_balancer_simulator_test_rpunit
the below tests from https://buildkite.com/redpanda/redpanda/builds/57974#019321c7-4e8d-4957-a814-705475128b44 have failed and will be retried
gtest_raft_rpunit
non flaky failures in https://buildkite.com/redpanda/redpanda/builds/56333#01927ae0-51b6-4b72-b6bf-2296ea352121:
"rptest.tests.idempotency_test.IdempotencyWriteCachingTest.test_idempotent_producers_write_caching"
non flaky failures in https://buildkite.com/redpanda/redpanda/builds/56333#01927ae1-317e-45e7-9bfe-c006e33f5696:
"rptest.tests.idempotency_test.IdempotencyWriteCachingTest.test_idempotent_producers_write_caching"
Retry command for Build#56333
please wait until all jobs are finished before running the slash command
/ci-repeat 1
tests/rptest/tests/idempotency_test.py::IdempotencyWriteCachingTest.test_idempotent_producers_write_caching
ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/57974#0193220c-9e19-4d88-a5b1-42bf76620b37