dgraph-docs icon indicating copy to clipboard operation
dgraph-docs copied to clipboard

Essential information missing on page about compression

Open d4h0 opened this issue 3 years ago • 0 comments

Hi,

The above-mentioned page doesn't mention the following important things:

  • vlog files are not compressed
  • values that are bigger than 1 MB are stored in vlog files (and therefore not compressed)

I think, there also should be information about what to do if many values bigger than 1 MB need to be stored.

For example: Can the threshold of 1 MB be increased?

Or: Can the vlog mechanism be deactivated? (I've seen your founder mention this possibility somewhere, but I believe, this wasn't implemented so far).

Edit:

Background/reference: A thread I started on the forum

It would also be useful to know if there is a built-in way to measure if the 1 MB threshold was reached. And also, what the 1 MB exactly is referring to (I'm assuming to all data of the key/value-pair).

Edit 2:

I'm also wondering if the 1 MB threshold is referring to the raw or the compressed data (being able to store 1 MB of compressed data vs. 1 MB of uncompressed data is a big difference).

d4h0 avatar Jan 24 '22 10:01 d4h0