Skip to content

Exp status docs update - #1489

Open
joshuamvining wants to merge 10 commits into
developfrom
exp-status-docs-update
Open

Exp status docs update#1489
joshuamvining wants to merge 10 commits into
developfrom
exp-status-docs-update

Conversation

@joshuamvining

Copy link
Copy Markdown
Collaborator

Description

  • added more explanation of the reproducibility process
  • added status table image

@joshuamvining joshuamvining added the docs Improvements or additions to documentation label Aug 19, 2026
Comment thread docs/experiment-status.rst Outdated

- run the same ``amg2023`` experiment setup twice with different ROCm versions,
- collect the metadata emitted by each generated workspace, and
- compare that metadata to identify what changed between the two runs.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would rewrite this as

  • First, we run the same amg2023 experiment setup twice on the same system with different ROCm versions
  • Second, we collect the metadata emitted by each generated workspace, and
  • Third, we compare that metadata to identify what changed between the two runs.

Comment thread docs/experiment-status.rst Outdated

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would use absolute paths here instead of relative

Comment thread docs/experiment-status.rst Outdated
@@ -69,10 +77,32 @@ After both runs complete, return to the Benchpark repository root:

cd ../../../..

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use absolute path here


. .gitlab/utils/compare-githash-metadata.sh \
wkp/tioga_rocm_6.4.2/amg2023/workspace/experiments/amg2023/problem1/amg2023_problem1_test_mpi_rocm_no_scaling_caliper_time_mpi_80_80_40_2_2_1_4/githash_metadata.json \
wkp/tioga_rocm_7.2.0/amg2023/workspace/experiments/amg2023/problem1/amg2023_problem1_test_mpi_rocm_no_scaling_caliper_time_mpi_80_80_40_2_2_1_4/githash_metadata.json

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we show the output of this script to demonstrate that it finds ROCm to be different versions?

Comment thread docs/experiment-status.rst Outdated

In a full GitLab CI run, we combine the same metadata comparison with pipeline job
status. The resulting table lets developers see both the final state of each experiment
and a possible reason a result differs from a previous or related run.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please expand on the table

@slabasan
slabasan force-pushed the exp-status-docs-update branch from 3ec3b04 to ddba773 Compare August 28, 2026 23:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants