HDFGroup
Investigate Hermes VOL
There has been interest in transparent dynamic data tagging in Hermes. However, this requires advanced knowledge of data format, which is difficult to know in a VFD. We will likely need a VOL.
We have a scientist with climate data. Some data has temperature, humidity, and pressure of ocean. Scientist is always interested in searching regions - e.g., regions with extremely high temperature.
Scientist creates a dataset for the region. Then, scientist gives it to the data management system to track temperature on the region.
Let's say we have an app with HDF5. HDF5 writes a 3D array. HDF5 calls Hermes. How does Hermes divide the 3D array?
The user interacts with HDF5. How does the user pass the intention through the HDF5 API?
- I might use a schema file and environment variables.
- HDF5 has VOL properties.
- We can decompose that array into regions.
- Then, we can find regions satisfying a custom, user-define function.
- We tag it.
