Skip to content

Robustify#62

Closed
dwr-psandhu wants to merge 3 commits intomasterfrom
robustify
Closed

Robustify#62
dwr-psandhu wants to merge 3 commits intomasterfrom
robustify

Conversation

@dwr-psandhu
Copy link
Copy Markdown
Contributor

Error handling for downloaders, reformatters and screeners so that a single station doesn't stop the rest from proceeding.

- Added exception handling in `cdec_download`, `des_download`, `nwis_download`, `noaa_download`, and `ncro_download` functions to log failures and return structured failure information.
- Updated `populate_repo` to collect and return station failures, writing them to a CSV file for better traceability.
- Implemented tests to ensure that downloaders and reformat functions continue processing despite individual station failures, capturing errors in a structured format.
- Enhanced `reformat` and `populate` functions to write failure logs even when no errors occur, ensuring a consistent output format.
- Added new test cases to validate the handling of failures in the auto-screening and downloading processes, ensuring robustness in error scenarios.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant