PyEMMA icon indicating copy to clipboard operation
PyEMMA copied to clipboard

Implied timescales calculation hangs with multiprocessing

Open yuxuanzhuang opened this issue 1 year ago • 0 comments

It seems to be a recurring question (related #1576 #1553 #1582 and maybe more). And I know you guys will replace the implementation of it in a future version of pyemma, but I just want to point out that the issue seems to be related to the combination of threadpool_limits and get_context("spawn").Pool---for some weird reason, they don't play nice with the serialization of MaximumLikelihoodMSM.

Either removing threadpool_limits or using get_context().Pool can resolve the hanging.

ubuntu 20.04 python: 3.10 pyemma: 2.5.12 threadpoolctl: 3.1.0

yuxuanzhuang avatar Mar 21 '23 12:03 yuxuanzhuang