ComplexityMeasures.jl icon indicating copy to clipboard operation
ComplexityMeasures.jl copied to clipboard

Feature: "increment entropy"

Open kahaaga opened this issue 5 months ago • 1 comments

The "increment entropy" paper defines a new OutcomeSpace that first embeds the input data, then encodes this data based on the difference between consecutive pairs of embedding vectors, including both sign information and magnitude information. This is an obvious new OutcomeSpace with corresponding encode/decode based on RectangularBinEncodings.

The method then estimated relative frequencies over the encoded symbols and plugs the estimated probabilities into an entropy formula.

We should implement the method.

kahaaga avatar Jan 15 '24 11:01 kahaaga

very similar to how the cosine similarity is implemented

Datseris avatar Feb 21 '24 09:02 Datseris