Repository navigation
Corpus refresh 2026-10-10: User Guide f5676ad..ac82c47, web 0 added, 10 changed, 1 removed, 5 failed - #94
Merged
Conversation
…10 changed, 1 removed, 5 failed User Guide f5676ad..ac82c47, 33 upstream commits: rcc-uchicago/user-guide@f5676ad...ac82c47. docs/: 51 added, 33 changed, 0 removed. Website: 55 of 55 listed pages fetched; 0 added, 10 changed, 1 removed, 5 failed; 65 sitemap pages available, not included. Re-measured into evals/corpus_baseline.json: same_page_twice +0 -2; shared_boilerplate +3 -0; unfindable_by_title +2 -0. Opened by .github/workflows/refresh-corpus.yml.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Corpus refresh, 2026-10-10
Merging: every guard passed and golden-set recall did not drop. Deploy is dispatched once this lands on main.
Guards
tools/corpus_check.py --updateruff check .pytest -qtools/assembly_check.pytools/metrics.py --against (golden-set recall must not drop)What the documents moved
Findings about the documents rather than the code, so the refresh re-measured them into
evals/corpus_baseline.jsoninstead of failing, and CI holds the corpus to that file from now on. None of them held up the merge; they are listed so that a page which went empty or stopped being findable is seen.One page indexed twice (a wasted result slot; the fix is in the scrape)
web/midway2.txt#1,web/support-and-services_midway2.txt#1web/midway2.txt#2,web/support-and-services_midway2.txt#2The same section on different pages (both kept: each cites its own page)
docs/tutorials/sde2/compute.md#slurm-partitions,docs/tutorials/sde3/compute.md#slurm-partitionsdocs/tutorials/sde2/data-transfer.md#method-1-download-data-from-a-website,docs/tutorials/sde3/data-transfer.md#method-1-download-data-from-a-websitedocs/tutorials/sde2/data-transfer.md#method-2-download-data-from-a-server,docs/tutorials/sde3/data-transfer.md#method-2-download-data-from-a-serverPages their own title does not find
docs/software/apps-and-envs/singularity.mddocs/tutorials/sde3/software.mdWebsite pages
Added (0)
Changed (10):
Removed (1):
midway2.txt: lands on the same page as https://rcc.uchicago.edu/support-and-services/midway2Failed (5):
Redirected (1):
Available, not included (65): in the sitemap and not in web_pages.toml. Add a page under [allow] to start fetching it, or under [deny] to stop it being listed here.
User Guide files
docs/: 51 added, 33 changed, 0 removed
docs/software/apps-and-envs/binsanity.mddocs/software/apps-and-envs/cesm.mddocs/software/apps-and-envs/meshlab.mddocs/software/apps-and-envs/wrf.mddocs/tutorials/sde2/compute.mddocs/tutorials/sde2/connection.mddocs/tutorials/sde2/data-transfer.mddocs/tutorials/sde2/images/avd1.pngdocs/tutorials/sde2/images/avd2.pngdocs/tutorials/sde2/images/avd3.pngdocs/tutorials/sde2/images/avd4.pngdocs/tutorials/sde2/images/avd5.pngdocs/tutorials/sde2/images/avd6.pngdocs/tutorials/sde2/images/avd7.pngdocs/tutorials/sde2/images/avd8.pngdocs/tutorials/sde2/images/avd9.pngdocs/tutorials/sde2/images/avd_desktop.pngdocs/tutorials/sde2/images/avd_desktop_add.pngdocs/tutorials/sde2/images/avd_desktop_workspace.pngdocs/tutorials/sde2/images/avd_login.pngdocs/tutorials/sde2/images/avd_webpage.pngdocs/tutorials/sde2/images/avd_winscp.pngdocs/tutorials/sde2/images/box_download.jpgdocs/tutorials/sde2/images/box_login.jpgdocs/tutorials/sde2/images/connection.pngdocs/tutorials/sde2/images/connection_sde2.pngdocs/tutorials/sde2/images/downloads.jpgdocs/tutorials/sde2/images/putty.jpgdocs/tutorials/sde2/images/putty_confirm.jpgdocs/tutorials/sde2/images/sde2_tmp.pngdocs/tutorials/sde2/images/tl_2fa.jpgdocs/tutorials/sde2/images/tl_login.jpgdocs/tutorials/sde2/images/tl_logout.jpgdocs/tutorials/sde2/images/tl_terminal.jpgdocs/tutorials/sde2/images/tl_terminal2.jpgdocs/tutorials/sde2/images/vdi_desktopicon.jpgdocs/tutorials/sde2/images/vdi_login.jpgdocs/tutorials/sde2/images/vdi_logout.jpgdocs/tutorials/sde2/images/vdi_putty.jpgdocs/tutorials/sde2/images/vdi_puttyserver.jpgdocs/tutorials/sde2/images/vdi_puttywarning.jpgdocs/tutorials/sde2/images/vdi_servername.jpgdocs/tutorials/sde2/images/winscp.jpgdocs/tutorials/sde2/images/winscp_hostkey.jpgdocs/tutorials/sde2/images/winscp_hostkey_sde2.pngdocs/tutorials/sde2/images/winscp_upload1.jpgdocs/tutorials/sde2/images/winscp_upload1_sde2.pngdocs/tutorials/sde2/images/winscp_upload2.jpgdocs/tutorials/sde2/images/winscp_upload2_sde2.pngdocs/tutorials/sde2/overview.mddocs/tutorials/sde2/software.mddocs/connection/ssh/main.mddocs/connection/thinlinc/troubleshooting.mddocs/data_sharing/access_control.mddocs/data_sharing/globus_sharing.mddocs/data_transfer/cloud/cloud-sync.mddocs/ecosystems.mddocs/glossary.mddocs/slurm/faq.mddocs/slurm/main.mddocs/slurm/sbatch.mddocs/software/apps-and-envs/gaussian.mddocs/software/apps-and-envs/gromacs.mddocs/software/apps-and-envs/mathematica.mddocs/software/apps-and-envs/matlab.mddocs/software/apps-and-envs/namd.mddocs/software/apps-and-envs/nwchem.mddocs/software/apps-and-envs/openmm.mddocs/software/apps-and-envs/r.mddocs/software/apps-and-envs/scode/environments.mddocs/software/apps-and-envs/scode/main.mddocs/software/apps-and-envs/scode/python.mddocs/software/apps-and-envs/singularity.mddocs/software/apps-and-envs/spaceranger.mddocs/software/apps-and-envs/tf-and-torch.mddocs/software/compilers.mddocs/software/faq.mddocs/software/index.mddocs/storage/main.mddocs/stylesheets/extra.cssdocs/tutorials/kicp.mddocs/tutorials/sde3/compute.mddocs/tutorials/sde3/data-transfer.mddocs/tutorials/sde3/overview.mdRetrieval metrics, before and after
corpus_check
What the refreshed corpus can and cannot answer
Opened by
.github/workflows/refresh-corpus.yml; CI does not run on pull requests a workflow opens, so the guards above ran in that workflow.