label-smoothing-visualization-pytorch
label-smoothing-visualization-pytorch copied to clipboard
Is the visualization TSNE?
(1) Pick three classes, (2) Find an orthonormal basis of the plane crossing the templates of these three classes, (3) Project the penultimate layer activations of examples from these three classes onto this plane. This visualization shows in 2-D how the activations cluster around the templates and how label smoothing enforces a structure on the distance between the examples and the clusters from the other classes.
Is this T-SNE? I am not so sure.
I believe it is not TSNE. However, it is a nice trial to use TSNE too.