poincare_embeddings icon indicating copy to clipboard operation
poincare_embeddings copied to clipboard

NumPy implementation of Poincaré Embeddings for Learning Hierarchical Representations (Facebook Research)

poincare_embeddings

NumPy implementation of Poincaré Embeddings for Learning Hierarchical Representations (Facebook Research).
Link to paper
Link to blog

poincare.py contains the crude implementation, poincare_adam.py contains my experiments with adam.

Sample results:

Without adam, three levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/3_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/3_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/3_181.png

With adam, three levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam3_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam3_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam3_181.png

Without adam, four levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/4_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/4_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/4_181.png

With adam, four levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam4_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam4_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam4_181.png