Skip to content

Investigate Hermes VOL #636

@lukemartinlogan

Description

@lukemartinlogan

There has been interest in transparent dynamic data tagging in Hermes.
However, this requires advanced knowledge of data format, which is difficult to know in a VFD.
We will likely need a VOL.

We have a scientist with climate data.
Some data has temperature, humidity, and pressure of ocean.
Scientist is always interested in searching regions - e.g., regions with extremely high temperature.

Scientist creates a dataset for the region.
Then, scientist gives it to the data management system to track temperature on the region.

Let's say we have an app with HDF5.
HDF5 writes a 3D array.
HDF5 calls Hermes.
How does Hermes divide the 3D array?

The user interacts with HDF5.
How does the user pass the intention through the HDF5 API?

  • I might use a schema file and environment variables.
  • HDF5 has VOL properties.
  • We can decompose that array into regions.
  • Then, we can find regions satisfying a custom, user-define function.
  • We tag it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions