Eidolon icon indicating copy to clipboard operation
Eidolon copied to clipboard

Concurrency issue with shared object linkage

Open ericspod opened this issue 8 years ago • 0 comments

Sometimes when executing compiled code using multiprocessing a system error occurs like this on Ubtun 14.04 (and possibly other Linux distros/versions) with Anaconda Python 2.7:

Inconsistency detected by ld.so: dl-open.c: 231: dl_open_worker: Assertion `_dl_debug_initialize (0, args->nsid)->r_state == RT_CONSISTENT' failed!

Initially this appeared to be a problem with MKL libraries used by Anaconda's numpy, but the issue appeared in code where numpy wasn't being used and after MKL was removed. The issue then appeared to be when compiling Cython code against Anaconda rather than compiling with the system Python. The problem is very intermittent and difficult to reproduce, especially in isolation from the rest of Eidolon, but is definitely concurrency related.

It now appears to be a bug in dlopen() itself which has since been apparently fixed in later versions of glibc.

ericspod avatar Feb 19 '18 13:02 ericspod