ai
ai copied to clipboard
oniani
From-scratch impls of AI models, approaches, tricks, and more!
ai
From-scratch impls of AI models, approaches, tricks, and more!
Setup
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
Contents
- Activation Functions and Their Derivative Functions from Scratch Using Pytorch
- Functions
- Gradient Descent
- Deep Learning
- Machine Learning Models from Scratch Using NumPy
- Representation
Activation Functions and Their Derivative Functions from Scratch Using Pytorch
- Sigmoid
- :rocket: Implementation
- :orange_book: Theory
- :chart_with_upwards_trend: Plot
- :tv: YouTube Video: Implementing Sigmoid and Its Derivative from Scratch
- ReLU
- :rocket: Implementation
- :orange_book: Theory
- :chart_with_upwards_trend: Plot
- :tv: YouTube Video: Implementing ReLU and Its Derivative from Scratch
- Leaky ReLU
- :rocket: Implementation
- :orange_book: Theory
- :chart_with_upwards_trend: Plot
- :tv: YouTube Video: Implementing Leaky ReLU and Its Derivative from Scratch
- GELU
- :rocket: Implementation
- :orange_book: Theory
- :chart_with_upwards_trend: Plot
- :tv: YouTube Video: Implementing GELU and Its Derivative from Scratch
- Swish
- :rocket: Implementation
- :orange_book: Theory
- :chart_with_upwards_trend: Plot
- :tv: YouTube Video: Implementing Swish and Its Derivative from Scratch
- SERF
- :rocket: Implementation
- :orange_book: Theory
- :chart_with_upwards_trend: Plot
- :tv: YouTube Video: Implementing SERF and Its Derivative from Scratch (r/MachineLearning special)
- :newspaper: r/MachineLearning reddit post by u/Shronnin: [R] [D] SERF activation function - improving Swish
- Tanh
- :rocket: Implementation
- :orange_book: Theory
- :chart_with_upwards_trend: Plot
- :tv: YouTube Video: Implementing Tanh and Its Derivative from Scratch
Deep Learning
- Image Classification: CNN for MNIST (+Deep Learning Project Setup)
- Image Classification: VGG Model from Scratch
- :rocket: Implementation
- :tv: YouTube Video: Image Classification: VGG Models from Scratch
- Recommender Systems: Generalized Matrix Factorization from Scratch
- :rocket: Implementation
- :tv: YouTube Video: Recommender Systems: Generalized Matrix Factorization from Scratch
Functions
- Distance Functions
- :rocket: Implementation
- :orange_book: Theory
- :tv: YouTube Video: Implementing Distance Functions from Scratch
- Convolution
- :rocket: Implementation
- :orange_book: Theory
- :tv: YouTube Video: Implementing a Convolution from Scratch (+ Baby Yoda)
Gradient Descent
- Discussing Batch, Stochastic, and Mini-Batch Gradient Descent
- :orange_book: Theory
- :chart_with_upwards_trend: Convex and Non-Convex Functions
- :tv: YouTube Video: Discussing Batch, Stochastic, and Mini-Batch Gradient Descent
Machine Learning Models From Scratch Using NumPy
- Gaussian Naive Bayes
- K-Nearest Neighbors (k-NN)
- Linear Regression
- Logistic Regression
- :rocket: Implementation
- :orange_book: Theory
- :orange_book: Computing Gradients
- :tv: YouTube Video: Implementing Linear Regression from Scratch
- k-Means Clustering
- :rocket: Implementation
- :orange_book: Theory
- :tv: YouTube Video: Implementing k-Means Clustering from Scratch
Representation
- Principal Component Analysis (PCA) from Scratch
- :rocket: Implementation
- :tv: YouTube Video: Implementing Principal Component Analysis (PCA) from Scratch
- TF-IDF from Scratch
- :rocket: Implementation
- :tv: YouTube Video: Implementing TF-IDF from Scratch
License
MIT License
oniani