Quorum queue segment consume all disc space

[PaniniHode]

Describe the bug

Facing the exact same issue as in this discussions/bugs: https://github.com/rabbitmq/rabbitmq-server/issues/6447 https://github.com/rabbitmq/discussions/issues/164 https://github.com/rabbitmq/rabbitmq-server/discussions/5258

In some random moment(Can't find the pattern) queue start to grown until disk is full(Or reach the disk watermark), one queue can consume 35-70GB from nothing, rps is low(About 100-1000 rps), total stored messages less then 10k and consumers are in reasonable amounts ~10-20. It happened about 5 times in two month.

server version is 3.13.6 official alpine based docker image.

What strange is, reduction(In runtime queue metrics) shows huge rps, always 5+ millions and it always goes down, when node is reach storage quota

Reproduction steps

As i said earlier, we can't find pattern, it's just happened and ruined one of the cluster nodes

Expected behavior

Normal disk usage :)

Additional context

No response