Bus error (Version: v20.0.0-rc.2.2)

[leighmcculloch]

Issue Description

Bus error when running stellar-core.

Steps to Reproduce

1. Run stellar-core for a while, running, generating meta.
2. Wait for random bus error to occur sometime later.

Expected Result

Continued running without issue.

Actual Result

Bus error.

Your Environment and Setup

stellar-core Version

$ stellar-core version
Warning: soroban-env-host-curr is running a pre-release version 20.0.0-rc1
v20.0.0-rc.2.2
rust version: rustc 1.72.1 (d5c2e9c34 2023-09-13) (Homebrew)
soroban-env-host: 
    curr:
        package version: 20.0.0-rc1
        git version: f19ef13363a1e0cbff7b100c0599a1d63dea88a6
        ledger protocol version: 20
        pre-release version: 57
        rs-stellar-xdr:
            package version: 20.0.0-rc1
            git version: d5ce0c9e7aa83461773a6e81662067f35d39e4c1
            base XDR git version: 9ac02641139e6717924fdad716f6e958d0168491

Environment

macOS arm64, no container.

Supporting Files

• stellar-core-20231116125143.log

[MonsieurNicolas]

As this build has been running in production for a while (but on x86), this points to some toolchain issue. Can you maybe build and run with asan enabled (as this points to potential memory corruption issues) as to catch the crash as early as possible (also, make sure to run from lldb as to capture a stack trace) and help pinpoint what is going on?

for reference here are the flags we use in CI:

• configure flags: --enable-tracy --enable-asan
• cxxflags: -ggdb -O3 -fstack-protector-strong -Wformat -Werror=format-security
• cflags: -ggdb -O3 -fstack-protector-strong -Wformat -Werror=format-security