wmd icon indicating copy to clipboard operation
wmd copied to clipboard

Deadlock in Multiprocessing

Open dancing-with-coffee opened this issue 6 years ago • 0 comments

Thank you for your implementation of your paper.

First, I tried with your code and data. It worked well. (all_twitter_by_line.txt)

Second, I tried 20newsgroup data which was in your paperwork.

Then, I got

"emd: Maximum number of iterations has been reached 1013"

error because of limitation, MAX_SIG_SIZE 100.

So, I change it to over maximum size of unique keywords in 20newsgroup dataset( =5284).

Now, I have trouble with blocking after some steps.

I think it's because of multiprocessing.

I check CPU availability, it was 99% in multiCPU, multicore environment.

Is there any solution for this?

dancing-with-coffee avatar Jul 30 '18 11:07 dancing-with-coffee