pmemkv-java icon indicating copy to clipboard operation
pmemkv-java copied to clipboard

[utils] add benchmark runner for YCSB

Open KFilipek opened this issue 4 years ago • 0 comments

RobsDB Ultra Benchmark Runner

Commit message

This tools allows to put multiple suites and run them one-by-one and parse the output to easy to use form as CSV files.

Description

Idea behind this PR is to provide tools to run multiple suites with YCSB using pmemkv-java. Original files with documentation was placed previously here.

Details

As draft this files are currently for: run_suite.py - parses test_suite.txt, produces summary and generate testplan.sh (your file to execute and collect data) run_workload.sh - this file is used from testplan.sh, run specific workload using YCSB, used internally by testplan.sh parser.py - parses YCSB output and provide CSV output

  • [x] Add draft files
  • [x] Adapt run_suite.py
    • [x] Use pmemkv specific fields
    • [x] Remove MongoDB related internals
    • [ ] Add removing pool file before next load phase
    • [ ] Add waiting for every YCSB instance finished work before next suite execution
    • [ ] Adapt output placement for supporting job splitting
  • [x] Adapt run_workload.sh
    • [x] Use pmemkv specific fields
    • [x] Extend in-file documentation with explanation what exact argument does
    • [ ] Add support splitting jobs and synchronization
  • [ ] Adapt parser.py
    • [ ] Add parsing splitted jobs
    • [ ] TBD
  • [ ] Optional: change filenames

This change is Reviewable

KFilipek avatar Mar 03 '21 14:03 KFilipek