receive-distributor: always restart, SIGSEGV and panic

[guozhiheng0123]

Thanos, Prometheus and Golang version used: Thanos Version: 0.34.1 docker image: quay.io/thanos/thanos:v0.34.1 Golang Version: go1.21.3

Object Storage Provider:

What happened: receive-distributor always restart, we found SIGSEGV and panic in logs

What you expected to happen:

How to reproduce it (as minimally and precisely as possible):

Full logs to relevant components:

Anything else we need to know:

[guozhiheng0123]

here is my logs

[guozhiheng0123]

add more logs

[fpetkovski]

Please see https://github.com/thanos-io/thanos/issues/6942