octopus icon indicating copy to clipboard operation
octopus copied to clipboard

rocksdb consistency test

Open UncP opened this issue 7 years ago • 3 comments
trafficstars

Suppose we have 5 rocksdb:

  1. generate a series of keys, eg. 100k. The first half is to insert, the other is to delete
  2. generate several ranges to perform delete range
  3. perform following operations based on above 100k keys and ranges
  4. for 50k insert, do a shuffle; for 50k delete, do a shuffle
  5. randomly choose from the 100k keys, and insert them in one of three ways: insert, batch insert, ingest sst
  6. for the 50k delete, delete them in one of two ways: delete, batch delete
  7. do delete range
  8. verify that all 5 db are exactly the same, then goto 1

UncP avatar Mar 28 '18 08:03 UncP

too many duplicated code with TiKV's, I worry that if we change TiKV's code, we need to not forget to change here.

siddontang avatar Mar 30 '18 15:03 siddontang

I tried using tikv as a lib, but that doesn't work, actually tried 2 times. I think later if we add another rocksdb test, we can re-use some code here, so that if tikv changes, we need only change one time.

UncP avatar Mar 31 '18 02:03 UncP

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Aug 19 '19 07:08 CLAassistant