awesome-ebm
awesome-ebm copied to clipboard
Collecting research materials on EBM/EBL (Energy Based Models, Energy Based Learning)
Awesome Energy Based Models/Learning (Awesome-EBM)
A comprehensive list of energy based learning papers and materials.
Table of Contents
- Workshops & Symposiums
- Representative Applications
-
Papers (Reverse Chronological Order))
- 2022
- 2021
- 2020
- 2019
- 2017 ~ 2018
- 2013 ~ 2016
- 2007 ~ 2012
- Early papers (Before 2007)
- Tutorials & Talks & Blogs
- Open Source Libraries
Workshops & Symposiums
Representative Applications
- [ ] Data (image/graph/sequence/etc) generation
- [ ] Discriminative learning: Classification/regression
- [ ] Density estimation
- [ ] Maximum entropy reinforcement learning
- [ ] Out-of-distribution detection (OOD)/anomaly detection/fraud detection
- [ ] Model calibration
- [ ] Adversarial robustness
- [ ] Image inpainting/denoising/super-resolution
- [ ] Prior modeling
- [ ] Model-based planning for robotics
- [ ] Language/Speech modeling
Papers (Reverse Chronological Order)
2022
2021
-
[ ] 2021: Durkan, Conor, and Yang Song.
On Maximum Likelihood Training of Score-Based Generative Models. -
[ ] Suhail, M., Mittal, A., Siddiquie, B., Broaddus, C., Eledath, J., Medioni, G., & Sigal, L. (2021).
Energy-Based Learning for Scene Graph Generation. arXiv preprint arXiv:2103.02221.[code]
2020
-
[ ] 2020: Niu, C., Song, Y., Song, J., Zhao, S., Grover, A., and Ermon, S.
Permutation invariant graph generation via score-Based generative modeling. In International Conference on Artificial Intelligence and Statistics (pp. 4474-4484). PMLR, 2020. [code] -
[ ] 2020: Khemakhem, Ilyes, et al.
ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICA. Advances in Neural Information Processing Systems 33 (2020). [code]
2019
-
[ ] 2019: Song, Y., and Ermon, S.
Generative Modeling by Estimating Gradients of the Data Distribution. In Proceedings of the 33rd Annual Conference on Neural Information Processing Systems, 2019. [code] -
[ ] 2019: Grathwohl, W., Wang, K. C., Jacobsen, J. H., Duvenaud, D., Norouzi, M., & Swersky, K.
Your classifier is secretly an energy based model and you should treat it like one. arXiv preprint arXiv:1912.03263, 2019. [code] -
[ ] 2019: Bian, Y., Buhmann, J., & Krause, A.
Optimal continuous dr-submodular maximization and applications to provable mean field inference. In International Conference on Machine Learning (pp. 644-653). PMLR. [code]
2017 ~ 2018
-
[ ] Mordatch, I. (2018).
Concept learning with energy-based models. arXiv preprint arXiv:1811.02486. [blog] -
[ ] Xie, J., Lu, Y., Gao, R., Zhu, S. C., & Wu, Y. N. (2018).
Cooperative training of descriptor and generator networks. IEEE transactions on pattern analysis and machine intelligence, 42(1), 27-45. [code] -
[ ] Gao, R., Lu, Y., Zhou, J., Zhu, S. C., & Wu, Y. N. (2018).
Learning generative convnets via multi-grid modeling and sampling. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 9155-9164). [code]
2013 ~ 2016
2007 ~ 2012
-
[ ] Javier R Movellan Jan 2008.
A minimum velocity approach to learning. unpublished draft
Early papers (Before 2007)
Tutorials & Talks & Blogs
-
[ ] Takayuki Osogami, Sakyasingha Dasgupta, 2017.
IJCAI-17 Tutorial: Energy-based machine learning. -
[ ] 2020 Youtube video: Arthur Gretton.
On the critic function of implicit generative models. -
[ ] UvA Deep Learning Tutorials Fall 2020.
Tutorial 8: Deep Energy-Based Generative Models