raft-engine icon indicating copy to clipboard operation
raft-engine copied to clipboard

Key value tombstone is lost during rewrite

Open tabokie opened this issue 4 years ago • 0 comments

Bug Report

Description

During Append queue rewrite, key value pairs of targeted Raft groups are scanned out and rewritten to Rewrite queue. After that, data files in Append queue is deleted.

However, in this process, key value tombstones (delete key operation) can't be detected and rewritten. Suppose rewrite is triggered after a Put and before a later Delete, the old key value is stored in Rewrite queue, but the subsequent deletion marker is purged from Append queue. When the engine restarts, the old key value will re-surface.

Right now, TiKV doesn't use kv delete API, so this bug is of minor urgency.

tabokie avatar Nov 08 '21 16:11 tabokie