Investigate Hermes VOL #636
Description
There has been interest in transparent dynamic data tagging in Hermes.
However, this requires advanced knowledge of data format, which is difficult to know in a VFD.
We will likely need a VOL.
We have a scientist with climate data.
Some data has temperature, humidity, and pressure of ocean.
Scientist is always interested in searching regions - e.g., regions with extremely high temperature.
Scientist creates a dataset for the region.
Then, scientist gives it to the data management system to track temperature on the region.
Let's say we have an app with HDF5.
HDF5 writes a 3D array.
HDF5 calls Hermes.
How does Hermes divide the 3D array?
The user interacts with HDF5.
How does the user pass the intention through the HDF5 API?
- I might use a schema file and environment variables.
- HDF5 has VOL properties.
- We can decompose that array into regions.
- Then, we can find regions satisfying a custom, user-define function.
- We tag it.