Skip to content

docs: crawlability runbook and CI crawl artifact checks - #7

Draft
cursor[bot] wants to merge 2 commits into
mainfrom
cursor/documentation-automation-system-4595
Draft

cursor[bot] wants to merge 2 commits into
mainfrom
cursor/documentation-automation-system-4595

Conversation

@cursor

@cursor cursor Bot commented Sep 14, 2026

Copy link
Copy Markdown

Docs added/updated

  • New: changelog-details/2026-09-10 - public-crawlability.adoc — single route list (site-routes.mjs), postbuild robots.txt / sitemap.xml, no-JS fallback, sitemap exclusions.
  • Updated: explanation/site-architecture.adoc — Public crawlability and Progressive themed SVGs sections (anchors for cross-links).
  • Updated: how-to/local-development.adoc — diagram sync scripts and postbuild crawl file inspection.
  • Updated: changelog.adoc and root CHANGELOG.adoc — 2026-09-14 doc pass index entry.

Codepaths covered

  • scripts/site-routes.mjs, scripts/write-crawlability.mjs, scripts/spa-fallback.mjs
  • app.config.ts prerender routes
  • PlayTime / semantic diagram sync (sync-playtime-diagrams.mjs, sync-semantic-diagrams.mjs) and @dev-centr/themed-svg runtime components

Knowledge gaps addressed

  • Where to register new public routes (avoid duplicate sitemap lists)
  • Why /blog is prerendered but omitted from the sitemap
  • How maintainers refresh and verify pinned diagram artifacts

CI

  • Verify .output/public/sitemap.xml and robots.txt after postbuild (with sitemap URL in robots).
Open in Web View Automation 

cursoragent and others added 2 commits September 14, 2026 16:05
Add Antora detail page for 2026-09-10 public crawlability, extend site
architecture and local development guides, and index the doc pass in
changelog.adoc.

Co-authored-by: Ryan Johnson <AMDphreak@users.noreply.github.com>
Co-authored-by: Ryan Johnson <AMDphreak@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant