Multicore-TSNE icon indicating copy to clipboard operation
Multicore-TSNE copied to clipboard

Published 20 hours ago • verified publisher icon DmitryUlyanov

Low CPU utilization during second phase

Open sovaa opened this issue 7 years ago • 2 comments

It says in "future work" that phase 2 can be improved, so maybe this is what you're referring to?

On phase 2 I see very low CPU utilization (see attached screenshot). Running Multicore-TSNE on 38 cores only utilize 1 core to 100% while the others lie at around 8%.

mc-tsne-low-cpu

sovaa avatar Mar 15 '17 08:03 sovaa

Exactly, phase 2 is not paralellized at all.

DmitryUlyanov avatar Mar 15 '17 13:03 DmitryUlyanov

i am finding that during stage two my CPUs are used in parallel in a periodic manner. If this stage is not parallelized, why do I see this kind of CPU utilization? Is there parallelization within each iteration? so different nodes are allocated to different CPU within each gradient descent iteration? cpu usage multicore tsne

ShobiStassen avatar May 11 '18 07:05 ShobiStassen