Repository navigation

Add catalog-reuse evaluation cards - #6333

Merged

FadhlanR merged 18 commits into

mainfrom

cs-13223-add-catalog-reuse-evaluation-cards

Oct 20, 2026

Merged

Add catalog-reuse evaluation cards#6333
FadhlanR merged 18 commits into
mainfrom
cs-13223-add-catalog-reuse-evaluation-cards

Commits on Oct 20, 2026
- Add catalog-reuse evaluation cards
  
  FadhlanR
  and
  claude
  committed
  1f41caf
- Replace the five single-axis reuse evals with one complex build
  
  FadhlanR
  and
  claude
  committed
  8dade8d
- Add an evaluation card for reference-vs-own on a Listing match
  
  FadhlanR
  and
  claude
  committed
  0b8571d
- Enable skill features per evaluation, keep platform failures out of the scores, and move the ownership eval to an installable Listing
  
  FadhlanR
  and
  claude
  committed
  8e7095c
- Drop the runner's stuck-pill click
  
  FadhlanR
  and
  claude
  committed
  c18caeb
- Count every realm-writing tool, keep room return and feature waits from failing a run, and mark unscored results
  
  FadhlanR
  and
  claude
  committed
  7fbee25
- Drop the unscored style from the report's lead stat, which never shows that tier
  
  FadhlanR
  and
  claude
  committed
  9a1c8f6
- Count a run's realm searches by route, both realm.cards.search and realm.entries.search
  
  FadhlanR
  and
  claude
  committed
  59f3205
- Let an evaluation set its own time target per prompt
  
  FadhlanR
  and
  claude
  committed
  34ba910
- Shorten workspace endpoints so a model copies the URL intact
  
  FadhlanR
  and
  claude
  committed
  cd3efc7
- Ask the reuse evaluations for a one-go build, give them 450 s per prompt, and drop the closing-line criteria the skills no longer teach
  
  FadhlanR
  and
  claude
  committed
  6ca7d79
- Add evaluations that check a search runs through a run-realm-code script
  
  FadhlanR
  and
  claude
  committed
  33471bd
- Stop a run only on consecutive failed turns, and report an empty bot reply as one
  
  FadhlanR
  and
  claude
  committed
  9c0ab87
- Grade the time from the first prompt, not from login
  
  FadhlanR
  and
  claude
  committed
  4da9334
- Name how many evaluations ship and rewrap the stop-rule line
  
  FadhlanR
  and
  claude
  committed
  0fa349e
- Add PR screenshot
  
  FadhlanR
  and
  claude
  committed
  6e86dbe
- Let EVAL_SKILL_FEATURES leave out an evaluation's feature, record a run's features on its result card, and document skillFeatures
  
  FadhlanR
  and
  claude
  committed
  09802aa
- Remove PR screenshot
  
  FadhlanR
  and
  claude
  committed
  952b74c

Commits

Commits on Oct 20, 2026