titan icon indicating copy to clipboard operation
titan copied to clipboard

Published 20 hours ago • verified publisher icon tikv

live-blob-size is much larger than total size of blob file

Open Little-Wallace opened this issue 5 years ago • 2 comments

image

Value of metric live-blob-size is much larger than total size of blob file, and when most of data has been removed, it is still so larger (ten times than its actual size).

The reason is Titan would add live-blob-size by the length of raw value every time it adds a new key into Blob file. , rather than encoded value. And it collects size of encoded value in BlobFileSizeCollector. When Titan deleted files, it would subtract live-blob-size by size stored in BlobFileSizeCollector. So the value it subtracted is always less than the value it added.

Little-Wallace avatar Nov 25 '19 11:11 Little-Wallace

How is the issue going？

caipengbo avatar Apr 21 '21 14:04 caipengbo

No progress. You can take a look. I guess it's due to the encoded value is in compression.

Connor1996 avatar Apr 22 '21 03:04 Connor1996