wevi
wevi copied to clipboard
Is it meaningful to put both input vectors and output vectors on the same plot
While playing and learning with your visualization, I noticed input vectors and output vectors are placed in the same space, and plotted on the same plot (after applying PCA). Input vectors and output vectors have the same dimensionality, but I'm wondering if you can interpret them in the same way. From my understanding, input vectors and output vectors pull and push each other but I can't think of any relations they might preserve. Can you make it more clear if you can extract any meaning from the relative positions of input and output vectors?
And thanks for making a great tool for understanding Word2vec. I really appreciate your work!
@dreamgonfly Seems he won't be able to answer your questions any more. Google his name and see what happened to him. Hope he shows up again alive.
About your question, he had some comments on that in his youtube video.
Output vectors carry equivalent information just representing the words differently. Think about it in a different way: Is there particular reason input vectors are preferred over the output vectors?