information-theory topic
dsit
Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"
UnsupervisedAttentionMechanism
Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".
tidy
Combine and clean word lists
alchemy
Generate any a-by-( b + c ) finite rectangle SVG containing potentially Infinitely many a-by-( 2 * b ) finite rectangles animated along a number line of ( ( c - b ) / a )^n scale symmetry.
pisac
Tensorflow 2 source code for the PI-SAC agent from "Predictive Information Accelerates Learning in RL" (NeurIPS 2020)
kxy-python
A toolkit to boost the productivity of machine learning engineers.
generated-wordlists
A repository for word lists I've generated
spkit
Signal Processing Toolkit, including ML models with visualization
information-theory-tool
Matlab code to compute entropy, conditional entropy, mutual information, channel capacity, and rate distortion.
EntropyHub.jl
An open-source toolkit for entropic data analysis