mlx
mlx copied to clipboard
Machine Learning Explorations - A list of machine learning resources
Machine Learning Explorations
A list of machine learning resources published between 2011 and 2021. More recent resources can be found in my repositories Awesome Generative AI and AI in 2023.
2021-12-20
- High-Resolution Image Synthesis with Latent Diffusion Models A paper by Rombach et al. on diffusion models for image generation, later used as the model behind Stable Diffusion. #synthesis
2021-07-07
- Evaluating Large Language Models Trained on Code. A paper by OpenAI introducing Codex, a GPT language model that translates language into code. Accompanying blog post. #nlp
2021-02-26
- Learning Transferable Visual Models From Natural Language Supervision A paper by OpenAI on CLIP (Contrastive Language-Image Pre-Training). Accompanying blog post. #nlp #vision
2020-05-28
- Language Models are Few-Shot Learners A paper by OpenAI on the training of GPT-3, an autoregressive language model with 175 billion parameters. #nlp
2019-05-28
- EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. A paper by Mingxing Tan and Quoc V. Le on a scaling method to achieve small and fast neural networks with high classification accuracy.
2019-03-13
- The Bitter Lesson. An essay by Richard Sutton on general-purpose methods, the leveraging of computation, and the fallacy of domain knowledge. #ai #reinforcementlearning
2019-02-14
- Language Models are Unsupervised Multitask Learners. A paper by OpenAI's A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever introducing the GPT-2 model for word prediction. Accompanying blog post. #nlp
2018-10-11
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. A paper by Google AI Language on a state-of-the-art language model for a wide variety of NLP tasks. Model weights available at https://github.com/google-research/bert. #nlp
2018-06-18
- Neural Ordinary Differential Equations. A paper by R. T. Q. Chen, Y. Rubanova, J. Bettencourt, and D. Duvenaud that defines neural networks as continuously evolving systems by parameterizing the derivative of their hidden states, using ODE solvers to find their final state. #dnn #ode
2018-04-19
- Artificial Intelligence — The Revolution Hasn’t Happened Yet. An essay by Michael I. Jordan on the current state of AI. #ai
2017-12-15
- Faceswap. Faceswap is a tool that utilizes deep learning to recognize and swap faces in pictures and videos. #deeplearning #video #fake
2017-10-26
- A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs. A paper by Vicarious introducing the recursive cortical network, a generative model with prior structure that facilitates model building, authored by D. George, W. Lehrach, K. Kansky, M. Lázaro-Gredilla, C. Laan, B. Marthi, X. Lou, Z. Meng, Y. Liu, H. Wang, A. Lavin and D. S. Pho. #captcha #vision
2017-07-20
- ShortScience.org Summaries of machine learning papers, provided by the community. Acompanying paper. #websites
2017-07-13
- Foolbox v0.8.0: A Python toolbox to benchmark the robustness of machine learning models. A Python toolbox to create adversarial examples that fool neural networks. Code repo. #adversarial #deeplearning #toolboxes #python
2017-07-06
- Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks. A paper by Pranav Rajpurkar, Awni Y. Hannun et al. that uses a 34-layer convolutional neural network which maps a sequence of ECG samples to a sequence of rhythm classes. #biomedical #cnn #deeplearning
2017-06-12
- Attention Is All You Need. A paper by Google Brain introducing Transformer networks for sequence transduction. #nlp
2017-06-07
- Functional neuroimaging of high-risk 6-month-old infants predicts a diagnosis of autism at 24 months of age. A paper by Robert W. Emerson et al. that uses pattern recognition techniques (SVM) on fMRI data. #autism #fmri #matlab #biomedical
2017-06-15
- Supercharge your Computer Vision models with the TensorFlow Object Detection API Release of TensorFlow Object Detection API. #Google #tensorflow #detection
2017-05-22
- pix2code: Generating Code from a Graphical User Interface Screenshot. A paper by Tony Beltramelli that converts a graphical user interface screenshot created by a designer into computer code. #gui #deeplearning #design
2017-04-19
- The GAN Zoo. A list of all named GANs. Accompanying blog post. #GAN #zoo
2017-03-30
- Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks CycleGAN paper by J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros. Official Torch implementation. #GAN #paper
2017-03-20
- Distill.pub A web-based peer-reviewed journal dedicated to clear explanations of machine learning. #journals
2017-03-15
- Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. DiscoGAN paper by T. Kim, M. Cha, H. Kim, J. Lee, and J. Kim. Official Torch implementation. #GAN
2017-03-07
- Machine Learning and Misinformation. A blog post by Paul Soulos about the destabilizing effects that disruptive technologies have when taken in a fragile social and economic climate that is slow to adapt. #GAN #psychology #beliefechos #confirmationbias
2017-02-02
- Dermatologist-level classification of skin cancer with deep neural networks. A paper by Andre Esteva on using convolutional neural networks to classify skin lesions. #cnn #deeplearning #tensorflow #biomedical
2016-11-06
- Deep Learning: The Unreasonable Effectiveness of Randomness. A blog post by Carlos E. Perez about meta-learning (including a machine that learns variants of the LSTM node), thoughts on models memorizing the training data, and networks with random weights. #metalearning #randomness
2016-10-13
- Uncertainty in Deep Learning. A blog post by Yarin Gal about his PhD Thesis on Bayesian Deep Learning through dropout. #dropout #bayesian #dl
2016-10-06
- Convolutional Variational Autoencoder, trained on MNIST. Interactive demo of convolutional variational autoencoder. #interactive #visualizations #cnn #vae
2016-10-03
- How to Use t-SNE Effectively. An interactive exploration of the t-SNE algorithm. #visualizations #interactive #tSNE
- cleverhans v2.0.0: an adversarial machine learning library. Cleverhans is a software library that provides standardized reference implementations of adversarial example construction techniques and adversarial training. #adversarial #deeplearning #toolboxes #python
2016-09-30
- Open Sourcing a Deep Learning Solution for Detecting NSFW Images. A Caffe DNN (ResNet 50) for detecting NSFW images, by Yahoo. #cnn
- Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. A paper by A. Nguyen, A. Dosovitskiy, J. Yosinski, T. Brox, and J. Clune. #papers #deeplearning #synthesis
2016-09-26
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. A Google Research paper on end-to-end automated translation. Accompanying blog post #lstm
2016-07-21
- Approaching (Almost) Any Machine Learning Problem. A post on practical ML pipelines by Abhishek Thakur. #pipelines #python
2016-07-13
- Matching Networks for One Shot Learning. A paper by Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, and Daan Wierstra. #papers #oneshot
2016-07-05
- Gradient Boosting Interactive Playground. An interactive demonstration-explanation of gradient boosting algorithm applied to classification problem. #visualizations #interactive #GB
2016-07-03
- Awesome Deep Learning Papers. A curated list of the most cited deep learning papers since 2012. #dl #papers
2016-06-21
- ML + AI advances 2016. An exhaustive list of ML and AI headlines of the past year. #overview #2016
2016-05-22
- Magenta: Music and Art Generation with Machine Intelligence. A Google project to make art with TensorFlow. #art #tensorflow
2016-04-28
- Interactive demonstrations for ML courses. A list of interactive demos: ROC curve, convnet.js (RandomForest, SVM, Neural network), Decision tree, Gradient Boosting (and decision tree for regression), Mini-course on reinforcement learning, TensorFlow NN, Image Reconstruction, t-SNE, Variational AutoEncoder, Generative adversarial networks, etc. #visualizations #interactive #list
- Movidius Fathom, a Neural Network Compute Framework embedded on a USB stick. #usb #hardware #deeplearning
2016-04-27
- OpenAI Gym. A toolkit for developing and comparing reinforcement learning algorithms. #reinforcementlearning #openai #python
2016-04-13
- CreativeAi. A space to share research and experiments that deal with Creativity and A.I. #art #ai
2016-04-12
- A Neural Network Playground. Play with neural networks. Brought by the TensorFlow team. #visualizations #interactive #tensorflow
2016-03-23
- Convolution arithmetic. A set of animations illustrating different convolutions, from the paper "A technical report on convolution arithmetic in the context of deep learning" by Vincent Dumoulin and Francesco Visin. #cnn #deeplearning
2016-03-09
- XGBoost: A Scalable Tree Boosting System. A paper by Tianqi Chen and Carlos Guestrin. #papers #boosting
2016-02-17
- Communication-Efficient Learning of Deep Networks from Decentralized Data A paper by researchers from Google introducing federated learning. #papers #federatedlearning
2016-01-22
- An Interactive Node-Link Visualization of Convolutional Neural Networks. A 3D interface by Adam W. Harley. #visualizations #interactive #cnn
2016-01-11
- Anthony Goldbloom gives you the secret to winning Kaggle competitions. A blog post reporting that XGBoost and Neural Networks are winning the majority of Kaggle competitions. #kaggle #xgboost #nn
2015-12-11
- Human-level concept learning through probabilistic program induction. A paper by Brenden M. Lake, Ruslan Salakhutdinov, and Joshua B. Tenenbaum. #papers #one-shot #bayes
2015-12-10
- Deep Residual Learning for Image Recognition. A paper by Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun introducing the ResNet architecture. #deeplearning
2015-12-03
- A mathematical motivation for complex-valued convolutional networks. A paper by Joan Bruna, Soumith Chintala, Yann LeCun, Serkan Piantino, Arthur Szlam, and Mark Tygert. #cnn #wavelets
2015-11-09
- TensorFlow, an open source software library for machine intelligence by Google. #opensource #google #deeplearning #tensorflow
2015-11-05
- Deepart.io. Generate images styled like your favorite artist #art
2015-10-12
- Grasp-and-Lift EEG Detection Winners' Interview: 1st place, Cat & Dog. #kaggle #timeseries #eeg
- Code and documentation for the winning sollution at the Grasp-and-Lift EEG Detection challenge. #code #python #github #kaggle
2015-10-05
- Grasp-and-Lift EEG Detection Winners' Interview: 3rd place, Team HEDJ. #kaggle #timeseries #eeg
2015-09-17
2015-09-10
- Spatial Transformer Networks. A paper by Max Jaderberg, Karen Simonyan, Andrew Zisserman, Koray Kavukcuoglu. And here's a demo on traffic sign recognition: The power of Spatial Transformer Networks #papers #code
2015-08-27
- Understanding LSTM Networks. A blog post tutorial on LSTMs by Christopher Olah. #lstm #rnn
2015-08-26
- A Neural Algorithm of Artistic Style. A paper by Leon A. Gatys, Alexander S. Ecker, Matthias Bethge. #papers #art
2015-08-03
- GitXiv: Collaborative Open Computer Science. A space to share links to open computer science projects. Each project is presented as arXiv + Github + Links + Discussion. #github #arxiv
2015-07-20
- Caffe Model Zoo. Caffe models for different tasks with all kinds of architectures and data. More on the GitHub Wiki #caffe #models #pretrained
2015-06-25
- Why Deep Learning Is a Hindrance to Progress Toward True AI. Blog post on the role of time in unsupervised learning. #unsupervisedlearning
2015-06-17
- Inceptionism: Going Deeper into Neural Networks. Blog post creating feature-enhanced images by turning recurrent neural networks upside down. #rnn
2015-06-11
- The Holy Grail of Deep Learning: Modelling Invariances. A blog post by Ferenc Huszár. #deeplearning
2015-06-08
- Neural Turing Machines. A paper by Alex Graves, Greg Wayne and Ivo Danihelka. #papers
- How to Evaluate Machine Learning Models: Hyperparameter Tuning. #hyperparameters
2015-06-04
- Competing in a data science contest without reading the data. Blog post that introduces the wacky boosting algorithm. #kaggle #boosting
2015-05-27
- Model-Based Machine Learning (Early Access): an online book. #books
- Yann LeCun, Yoshua Bengio & Geoffrey Hinton - Deep Learning. Article in nature (paywalled). #papers #deeplearning
2015-05-25
- Siamese Neural Networks for One-Shot Image Recognition A paper by Gregory Koch, Richard Zemel, and Ruslan Salakhutdinov. #papers #deeplearning
2015-05-21
- The Unreasonable Effectiveness of Recurrent Neural Networks. Blog post by Andrej Karpathy. #rnn
2015-05-18
- U-Net: Convolutional Networks for Biomedical Image Segmentation. A paper by O. Ronneberger, P. Fischer, and T. Brox on U-Net image segmentation, including source code. #papers #matlab #caffe
2015-04-06
- Early Stopping is Nonparametric Variational Inference. A Bayesian interpretation of early-stopping stochastic gradient descent. #papers
2015-03-29
- CS224d: Deep Learning for Natural Language Processing. #courses
- Data Mining Courses. Overview of online machine learning and data mining courses. #courses
2015-02-14
- Tutorial to configure an AWS instance to run Theano. #gpu #theano #aws
2015-02-13
- Using convolutional neural nets to detect facial keypoints tutorial. Tutorial by Daniel Nouri on using Theano and Lasagne for detecting facial keypoints through deep convolutional regression. #deeplearning #cnn #theano #pretrained #regression
2015-02-11
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. A paper by Sergey Ioffe and Christian Szegedy. #papers #deeplearning
2015-01-24
- Visualizing DBSCAN Clustering. Interactive demo of DBSCAN clustering algorithm. #clustering #dbscan #interactive #visualization
2015-01-01
2014-12-21
- Do Deep Nets Really Need to be Deep? "Once a deep network is trained, a shallow network can learn the same function from the outputs of the deep network. The shallow network can't learn the same function directly from the data. This indicates that deep learning could be an optimization/learning trick". Via Nuit Blanche #papers #deeplearning
2014-12-17
- Learning Deep Architectures for AI. A paper on the motivation for deep architectures, by Yoshua Bengio. #papers #ai
- "Using convolutional neural nets to detect facial keypoints tutorial." A tutorial by Daniel Nouri on how to perform regression using Theano + Lasagne + nolearn to find keypoints in pictures of face. #tutorial #theano #deeplearning
- "Deep Learning Tutorial". A tutorial on creating an AWS instance to run Theano. #kaggle #deeplearning #aws
2014-12-09
- Do We Need Hundreds of Classifiers to Solve Real World Classification Problems? A paper by Manuel Fernández-Delgado, Eva Cernadas and Senén Barro. #paper #classification
2014-12-03
- So You Wanna Try Deep Learning? Crash-course into deep learning including a one-file python implementation of a deep neural network. #code
2014-09-29
- Tom M. Mitchell - The Discipline of Machine Learning. #papers
- An interview with Judea Pearl #interviews #ai
2014-09-28
2014-09-18
- Long short term memory. Wikipedia entry. #lstm #rnn
2014-09-15
- Deep Learning: Past, Present and Future. Slides by Kyunghyun Cho. #tutorial #deeplearning
2014-09-08
- Accelerate Machine Learning with the cuDNN Deep Neural Network Library #deeplearning #toolboxes
2014-09-05
- Intro to Artificial Intelligence. Course by Sebastian Thrun and Peter Norvig on Udacity. #courses #online_courses
- Using deep learning to listen for whales. Daniel Nouri's notes on the Kaggle Whale Detection Challenge. #deeplearning #kaggle
2014-09-04
- Kernel Methods Match Deep Neural Networks On TIMIT. Via Reddit #kernelmethods #deeplearning #papers
2014-08-31
- A Deep Learning Tutorial: From Perceptrons to Deep Networks. High-level overview of deep learning. #tutorials #deeplearning
- Stochastic Pooling for Regularization of Deep Convolutional Neural Networks. A talk by Matthew D. Zeiler. Stochastic pooling: treat activations as probabilities and pick one with the corresponding probability. At test time: weight activations with probabilities. Implemented using GPUmat with cuda-convnet #videos #deeplearning
2014-08-30
- The History of AI. #AI #charts
2014-08-29
- Who is the best at X? Benchmark visual recognition tests and comparison of results by state-of-the-art algorithms. #benchmarks #vision
2014-08-26
- Deep-er Kernels. A talk by John Shawe-Taylor #videos #kernelmethods #deeplearning
2014-08-25
- Recommending music on Spotify with deep learning. A blog post by Sander Dieleman #deeplearning
2014-08-24
- Deep Learning. An MIT Press book by Yoshua Bengio, Ian Goodfellow and Aaron Courville. #books #pdf #deeplearning
- Signal and Image Classification - Stephane Mallat Technion lecture. Via Nuit Blanche #videos #wavelets #deeplearning
- Transforming Auto-encoders. Paper by G. E. Hinton, A. Krizhevsky & S. D. Wang, introducing the idea of "capsules". #papers #deeplearning #capsules
- The Data Scientist on a Quest to Turn Computers Into Doctors. Article on Jeremy Howard's company Enlitic #deeplearning #vision #medicine #companies #articles
- Indolent or aggressive? A computerised pathologist that can outperform its human counterparts could transform the field of cancer diagnosis. Article on Daphne Koller's Computational Pathologist. #articles #medicine #vision
2014-08-19
- Timeseries Classification: KNN & DTW. An iPython notebook by Mark Regan. #python #dtw #knn #timeseries
2014-08-14
- Neural Networks course by Hugo Larochelle. #courses #videos #deeplearning
2014-08-10
- Neural Networks and Deep Learning. Online book by Michael Nielsen. #books #deeplearning
2014-08-07
- Winning solution for the DecMeg2014 challenge. #code #matlab #github #kaggle
2014-08-04
- Deep Learning and Convolutional Kernel Networks. #deeplearning #kernelmethods
2014-07-31
- UFLDL Tutorial. Stanford tutorial on deep learning. My solutions on Github: Sparse Autoencoder., Sparse Autoencode Vectorized, Softmax Regression, Self-Taught Learning, Linear Decoder, Stacked Autoencoder and Convolutional Neural Network. #courses #deeplearning
2014-07-29
- Kaggle Competition Past Solutions. #kaggle #code
2014-06-21
- Towards End-to-End Speech Recognition with Recurrent Neural Networks. A paper by Alex Graves and Navdeep Jaitly. #rnn #lstm
2014-06-10
- Generative Adversarial Networks. A paper by Ian J. Goodfellow et al. that proposes a framework for estimating generative models via an adversarial process. #gan
2014-02-14
- ConvNetJS: Deep Learning in your browser. Javascript machine learning #code #deeplearning
2013-10-25
- "Learning Hierarchies Of Invariant Features". Slides by Yann LeCun. #tutorial #deeplearning
2012-12-03
- ImageNet Classification with Deep Convolutional Neural Networks. A paper by Alex Krizhevsky, Ilya Sutskever and Geoffrey E. Hinton. #deeplearning #cnn
2011-03-11
- How to Grow a Mind: Statistics, Structure, and Abstraction. A paper by Joshua B. Tenenbaum, Charles Kemp, Thomas L. Griffiths, and Noah D. Goodman. #bayes #brain #science