information-theory-tool icon indicating copy to clipboard operation
information-theory-tool copied to clipboard

Matlab code to compute entropy, conditional entropy, mutual information, channel capacity, and rate distortion.

information-theory-tool

This toolbox contains Matlab source code for basic computations in information theory.

You can compute:

  • entropy
  • conditional entropy
  • mutual information
  • channel capacity
  • rate distortion

Functions and several examples are provided, as well as their experiment results in figures.

v1.0 June 28, 2020 Initial release