CI failing on julia 1.8.1 with Seg fault/memory error

[BSnelling]

The CI is failing on julia 1.8.1 for x86 with either a Segmentation fault or an LLVM memory error.

LLVM error example: https://github.com/JuliaDiff/ChainRules.jl/actions/runs/3087367821/jobs/4992664313

LLVM ERROR: out of memory
Allocation failed

signal (6): Aborted
in expression starting at /home/runner/work/ChainRules.jl/ChainRules.jl/test/rulesets/LinearAlgebra/symmetric.jl:1
__kernel_vsyscall at linux-gate.so.1 (unknown line)
gsignal at /lib32/libc.so.6 (unknown line)
abort at /lib32/libc.so.6 (unknown line)

Segmentation fault example: https://github.com/JuliaDiff/ChainRules.jl/actions/runs/3095156256/jobs/5009272412

Testing rulesets/LinearAlgebra/symmetric.jl:

signal (11): Segmentation fault
in expression starting at /home/runner/work/ChainRules.jl/ChainRules.jl/test/rulesets/LinearAlgebra/symmetric.jl:1
unknown function (ip: 0xf7ec43e0)

Both errors happen during the rulesets/LinearAlgebra tests.