velocypack icon indicating copy to clipboard operation
velocypack copied to clipboard

Performance misleading - no JSON with gzip

Open ChrisJefferson opened this issue 8 years ago • 4 comments

Why do you show vpack with gzip, but not JSON with gzip (especially as JSON tends to gzip very well)

ChrisJefferson avatar Mar 10 '16 13:03 ChrisJefferson

I took the first file, api-docs.json, and with gzip -9, json wins! (size 99,932)

ChrisJefferson avatar Mar 10 '16 13:03 ChrisJefferson

Originally, we did not have compression in this table at all, because one of the most important features of VelocyPack for us is that one can access substructures efficiently without deserialising! Obviously, this does not work with compression. We have added the gzipped sizes of the compact VelocyPack because somebody asked for them.

You are right, we should also add a column for the sizes of the gzipped JSON documents. I would not be surprised if they are comparable or even smaller to the sizes of the compressed VelocyPack, since the "overhead" of JSON can be zipped relatively well. VelocyPack adds binary index tables which can probably not be zipped very well.

I'll keep this open until we got round to add the numbers.

neunhoef avatar Mar 10 '16 13:03 neunhoef

I should have said, for me you could also remove the gzips (or perhaps put them in another table with an explanation).

P.S. Hi @neunhoef

ChrisJefferson avatar Mar 10 '16 13:03 ChrisJefferson

A different table would be an alternative approach, removing would probably make the person who asked for it unhappy.

P.S. Hi @ChrisJefferson

neunhoef avatar Mar 10 '16 13:03 neunhoef