rust-pgn-reader icon indicating copy to clipboard operation
rust-pgn-reader copied to clipboard

Published 20 hours ago • verified publisher icon niklasf

Compression with game phase

Open ErdoganSeref opened this issue 2 years ago • 5 comments

Extending the script for lichess-org/lila#4129. Added the method codes so the script is compatible to the Python script.

ErdoganSeref avatar Mar 28 '23 14:03 ErdoganSeref

Hi. Could it be that we need three separate code books?

niklasf avatar Apr 09 '23 12:04 niklasf

codes.txt is the output of the script.

ErdoganSeref avatar Apr 09 '23 21:04 ErdoganSeref

So that's now 20.92 + 12.26 + 3.74 = 36.92 bytes per game, compared to the current 37.03. A very slight improvement.

niklasf avatar Apr 10 '23 08:04 niklasf

I expected a bigger improvement. Is the improvement worth the added complexity?

ErdoganSeref avatar Apr 10 '23 15:04 ErdoganSeref

Probably no. It's disappointing, but still good to have tried this approach.

We could still play with the cutoff points, but having seen these results, I wouldn't expect much. I guess it shows that the ordering heuristic does most of the heavy lifting, and that it isn't particularly sensitive to game phase.

niklasf avatar Apr 10 '23 17:04 niklasf