density icon indicating copy to clipboard operation
density copied to clipboard

Improve efficiency for small files

Open g1mv opened this issue 9 years ago • 1 comments

It takes a certain amount of data for density's algorithms to be running optimally (ratio wise). Adding an intermediary processing could be interesting before routing data to the bigger and faster algorithms. It would also enable preparation of the main algorithm's data structures, while ensuring a good compression ratio immediately thus greatly benefiting smaller files. As a side effect, #10 would be probably unnecessary as the compression process would be instantly efficient.

g1mv avatar Apr 01 '15 14:04 g1mv

As a reference, here are the compression ratio convergence curves for the 3 algorithms using enwik7, as of 0.12.4 beta.

x-axis => input size read in bytes y-axis => compression ratio, between 0 and 1

green curve => overall compression ratio red curve => spot compression ratio

chameleon Density Chameleon

cheetah Density Cheetah

lion Density Lion

g1mv avatar May 27 '15 01:05 g1mv