h5bench icon indicating copy to clipboard operation
h5bench copied to clipboard

Added support for Cache VOL

Open zhenghh04 opened this issue 3 years ago • 6 comments

This allows h5bench to pause the async operations in Cache VOL and start them later after issuing out all the dataset write calls.

zhenghh04 avatar Aug 26 '21 21:08 zhenghh04

@zhenghh04 could you also add the documentation for this?

jeanbez avatar Oct 01 '21 17:10 jeanbez

@zhenghh04 Could you please add / update documentation on how to use the benchmark with Cache VOL?

sbyna avatar Nov 09 '21 20:11 sbyna

@zhenghh04 do you have any updates?

jeanbez avatar Feb 23 '22 20:02 jeanbez

Main changes:

  • h5bench_write.c: please check regions with -DUSE_CACHE_VOL
  • h5bench_util.c: please check regions with -DUSE_CACHE_VOL
  • h5bench:
    • added json parser for Cache VOL.
    • enabling vol as long as vol[‘connector'] is not empty (previously it requires async vol to be set)
  • CMakeLists.txt: included Cache build instruction support
  • docs: added related documentation for cache VOL (build instruction, setup, etc)
  • .github/workflows/h5bench-hdf5-develop.yml: added Cache VOL building, h5bench + cache vol building, testing

zhenghh04 avatar Apr 11 '22 19:04 zhenghh04

@sbyna and @houjun if you have some time available, could you help us double-check this new feature? @zhenghh04 I've included some additional test cases and checked the changes, it seems good to me.

jeanbez avatar May 02 '22 02:05 jeanbez

@jeanbez @houjun I pushed a new commit:

I added back "MODE" option in cfg file for Cache VOL support. If the user does not set MODE in the cfg file, then it will be as it used to be: i.e., determined merely by whether async vol connector is used or not.

I also removed the barrier.

zhenghh04 avatar Dec 06 '22 04:12 zhenghh04