pandarallel
pandarallel copied to clipboard
nalepae
Progress stops at some moment and doesn't move
Hi, I was faced with a problem, when at some moment the progress stops even if the RAM is free enough and doesn't move how long you would wait.
I too see this often. On one of my project one in four runs fails. It's not consistent.
Same here- doing a lambda function on a large dataframe hangs at seemingly random points, some threads run to completion and others fail. try-catching in the lambda function doesn't seem to help in any way either, so it doesn't appear that the function itself is hanging, but the actual pandarallel instance.
Same here. It worked for some time by disabling the progress_bar, yet it still randomly hangs, leaving workers idle and blocking the whole program.
Have you guys found any solution for the problem? It randomly hangs for me as well.
I have observed that it hangs when one of the workers has had an error/exception.
Hey @vishal-wadhwa,
how did you observe this? Do you think the problem is that the exception of the worker is never properly raised? Do you have some simple code to reproduce the issue?
