Skip to content

[Feature]: Store hash of time series files when using TDR #889

@gschivley

Description

@gschivley

Feature description

Create a new file (csv or json) in the TDR_Results folder that stores a hash of each original time series file (gen variability, demand, fuels). When GenX runs and checks time_domain_reduced_files_exist, also check the stored hash values against the original time series files.

It might also be good to also hash the time_domain_reduction_settings.yml file in case the TDR settings were changed.

Motivation

Using TDR creates a folder TDR_Results with data for the selected time series periods. GenX looks for this folder and reads the data in future runs if it already exists. If the original time series data (or TDR settings) are changed it is easy for users to forget that they need to delete the TDR_Results folder.

Implementation strategy

Create a new function, maybe time_series_files_changed, that loads the file with hash values (if it exists). Recalculate the hash from the full time series files and compare the two. Maybe a second function to check the TDR settings hash (or combine in a single function).

If the hash file doesn't exist, assume that TDR needs to be re-run. Running TDR a second time will overwrite the existing TDR_Results files.

Additional context

No response

Metadata

Metadata

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions