If facing error while running local inference try using this export OMP_NUM_THREADS=1

[ethicalvats]

I was facing problem running inference locally

then used lldb to trace the issue and found it was related to OpenMP

export OMP_NUM_THREADS=1

solved my problem