clearml RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.

RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.

Open c0g opened this issue 6 months ago • 1 comments

Running jax and clearml in the same process, I get

/home/tom/miniforge3/envs/tomrl/lib/python3.10/site-packages/clearml/utilities/process/mp.py:629: RuntimeWarning:

os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.

I haven't yet got it to run far enough to see if there's indeed a deadlock. Curious if anyone has seen this before.

Aug 20 '24 15:08 c0g