hermes
hermes copied to clipboard
Extending the HDF5 library to support intelligent I/O buffering for deep memory and storage hierarchy systems
Remove `[]` in `Usage` output since they are all required parameters. ``` [hyoklee@jelly]/scr/hyoklee/src/hermes/build/data_stager/test/Testing/Temporary\ > stage_in Usage: mpirun -n [nprocs] ./stage_in [url] [offset] [size] [dpe] ```
Garbage input generates `Segmentation fault.` ``` [hyoklee@jelly]/scr/hyoklee/src/hermes/build/data_stager/test/Testing/Temporary\ > mpirun -n 1 stage_in 2 3 4 5 WARNING: Logging before InitGoogleLogging() is written to STDERR I1212 08:08:57.493853 27855 hermes.cc:419] Initializing hermes...
- [x] Re-run the unit test for stage-in on personal machine or Ares (or both). - [ ] Add a unit test for directory stage-in (similar to the unit test...
Function naming is not consistent. ``` void TestWriteDataset(const std::string &dset_name, const std::vector &data) { Hdf5Api api; api.MakeDataset(test::hermes_hid, dset_name, data); api.MakeDataset(test::sec2_hid, dset_name, data); } void TestMakeCompactDataset(const std::string &dset_name, const std::vector &data)...
Here are the functions: ``` /Users/hyoklee/src/hermes/src/buffer_organizer.cc:40: warning: Member LocalGetBufferInfo(SharedMemoryContext *context, BufferID buffer_id) (function) of namespace hermes is not documented. /Users/hyoklee/src/hermes/src/buffer_organizer.cc:57: warning: Member GetBufferInfo(SharedMemoryContext *context, RpcContext *rpc, BufferID buffer_id) (function) of...
If the environment variable `HDF5_DRIVER_CONFIG` is not set, then the VFD segfaults. We should choose default values for the page size and flushing options.
Hermes won't compile on Ubuntu 22.04. Either __fxstat was removed, they changed the headers, or they require some additional macro to enable it. We should figure out what APIs need...
Put to an existing blob deletes the entire blob's metadata. This results in concurrency problems when multiple processes Put to the same blob.
I've only seen this fail once in CI. I need to run it on the CI machine several times to reproduce the failure.