deep-speaker icon indicating copy to clipboard operation
deep-speaker copied to clipboard

feat: parallel processing.

Open ooobsidian opened this issue 4 years ago • 8 comments

Parallel processing is used in the generation of speech feature files.

ooobsidian avatar May 16 '20 15:05 ooobsidian

@ooobsidian so actually it's already using multi threading to process the audio. Just run the commands and you'll see that all your cores are used. This PR does not seem to be necessary. Let me know!

philipperemy avatar May 18 '20 04:05 philipperemy

But I only have one thread in execution, and it's slow.

ooobsidian avatar May 18 '20 04:05 ooobsidian

Hum that's weird. When I run the code, mine uses all my 12 cores.

philipperemy avatar May 18 '20 04:05 philipperemy

I hope you can merge this PR, as there is only one core in use at my runtime.

ooobsidian avatar May 18 '20 04:05 ooobsidian

But let's try to understand first why before I merged. Because in my case if I start the program with multi processes and multi threadings at the same time, it will go bad.

philipperemy avatar May 18 '20 05:05 philipperemy

Anyhow, I want make it faster.

ooobsidian avatar May 18 '20 05:05 ooobsidian

@ooobsidian sure go ahead with your implementation for now. I'll need to check that in details to understand why we have different behaviors :)

philipperemy avatar May 18 '20 05:05 philipperemy

I think it should be running this program at the same time as the other programs, causing the IO to be slow.

ooobsidian avatar May 18 '20 05:05 ooobsidian