d3fc-webgl-hathi-explorer icon indicating copy to clipboard operation
d3fc-webgl-hathi-explorer copied to clipboard

Help for playing the audio when mouse over the point

Open xiaozhah opened this issue 4 years ago • 4 comments

Thank you Colin Eberhardt. I find your solution for the big dataset is very useful and fork your project at here It solves the memory pressure when I used SVG to plot the points (459750 points). Now it looks like this: image

I tried to play the audio when I mouse over the point, such as my previous attempt

image

Thus I tried this code but it fails image image

I want to know how to implement this in this project?

Best Regards, Xiao

xiaozhah avatar May 03 '20 02:05 xiaozhah

The point component doesn't provide mouseover events - it fires every time the cursor moves. If you track which is the closest point, you can use this to fire when the annotation 'snaps' to a new location - https://github.com/xiaozhah/d3fc-webgl-UniNet/pull/1

ColinEberhardt avatar May 03 '20 07:05 ColinEberhardt

Just out of interest, what is your dataset? and what does it mean?

ColinEberhardt avatar May 03 '20 07:05 ColinEberhardt

Thank you very much, I try your idea later. Speech can be divided into many small units, such as phones. In speech synthesis, the neural network such as Tacotron2 can map all phones of the corpus into a very large matrix (459750 * 256 dim in our corpus). By observing the results of tSNE dimensionality reduction (459750 * 2 dim, also our dataset), you can find the quality of clustering, such as whether clusters of the similar sound are clustered together, and whether clusters of the same color (representing the same phone name) are also clustered together

xiaozhah avatar May 03 '20 07:05 xiaozhah

Ok I got it. Thank you! image

xiaozhah avatar May 03 '20 09:05 xiaozhah