From 68460a8fdee4182f65969942c26cff0af2ebc1cf Mon Sep 17 00:00:00 2001 From: Ben Vinegar Date: Sun, 26 Apr 2026 17:13:44 -0400 Subject: [PATCH] Refresh README and benchmark snapshots --- README.md | 54 +- .../known-ai-vs-solid-oss/agent-ci.jsonl | 2 +- .../history/known-ai-vs-solid-oss/astro.jsonl | 2 +- .../known-ai-vs-solid-oss/devworkbench.jsonl | 2 +- .../known-ai-vs-solid-oss/emdash.jsonl | 2 +- .../history/known-ai-vs-solid-oss/execa.jsonl | 2 +- .../known-ai-vs-solid-oss/fulling.jsonl | 2 +- .../known-ai-vs-solid-oss/gstack.jsonl | 2 +- .../history/known-ai-vs-solid-oss/hunk.jsonl | 2 +- .../history/known-ai-vs-solid-oss/hyper.jsonl | 2 +- .../history/known-ai-vs-solid-oss/latest.json | 3140 ++++++++-------- .../known-ai-vs-solid-oss/node-notifier.jsonl | 2 +- .../known-ai-vs-solid-oss/openclaw.jsonl | 2 +- .../known-ai-vs-solid-oss/openusage.jsonl | 2 +- .../known-ai-vs-solid-oss/payload.jsonl | 2 +- .../history/known-ai-vs-solid-oss/tsup.jsonl | 2 +- .../history/known-ai-vs-solid-oss/umami.jsonl | 2 +- .../known-ai-vs-solid-oss/vinext.jsonl | 2 +- .../history/known-ai-vs-solid-oss/vite.jsonl | 2 +- .../known-ai-vs-solid-oss/zustand.jsonl | 2 +- benchmarks/results/known-ai-vs-solid-oss.json | 1025 ++---- benchmarks/results/rule-signal-mini.json | 3154 +++++++---------- reports/known-ai-vs-solid-oss-benchmark.md | 82 +- reports/known-ai-vs-solid-oss-history.md | 60 +- reports/rule-signal-mini.md | 422 +-- src/rules/duplicate-mock-setup/README.md | 2 +- src/rules/empty-catch/README.md | 2 +- src/rules/error-obscuring/README.md | 2 +- src/rules/error-swallowing/README.md | 2 +- src/rules/generic-record-casts/README.md | 11 +- src/rules/generic-status-envelopes/README.md | 11 +- src/rules/pass-through-wrappers/README.md | 2 +- src/rules/promise-default-fallbacks/README.md | 11 +- .../stringified-unknown-errors/README.md | 11 +- 34 files changed, 3482 insertions(+), 4545 deletions(-) diff --git a/README.md b/README.md index 833a107..7c49d17 100644 --- a/README.md +++ b/README.md @@ -129,7 +129,7 @@ slop-scan delta --base ../main --fail-on added,worsened ## What it catches -Current checks focus on patterns that often show up in unreviewed generated code: +Current default-pack checks focus on patterns that often show up in unreviewed generated code: - [log-and-continue catch blocks](src/rules/error-swallowing/README.md) - [error-obscuring catch blocks](src/rules/error-obscuring/README.md) (default-return or generic replacement error) @@ -166,13 +166,13 @@ _Why before Jan 1, 2025?_ Because this cutoff aims to catch mature OSS before AI | Metric | AI median | Mature OSS median | Ratio | | ------------------- | --------: | ----------------: | --------: | -| Blended score | **3.02** | **1.00** | **3.02x** | -| Score / file | **0.99** | **0.24** | **4.11x** | -| Score / KLOC | **9.51** | **4.04** | **2.35x** | -| Score / function | **0.22** | **0.10** | **2.28x** | -| Findings / file | **0.31** | **0.08** | **3.74x** | -| Findings / KLOC | **2.96** | **1.38** | **2.14x** | -| Findings / function | **0.08** | **0.04** | **2.21x** | +| Blended score | **6.91** | **1.00** | **6.91x** | +| Score / file | **1.07** | **0.12** | **8.82x** | +| Score / KLOC | **10.90** | **1.48** | **7.38x** | +| Score / function | **0.28** | **0.05** | **5.51x** | +| Findings / file | **0.29** | **0.04** | **6.97x** | +| Findings / KLOC | **3.04** | **0.56** | **5.39x** | +| Findings / function | **0.08** | **0.02** | **3.51x** | ### Rolling benchmark snapshot @@ -180,24 +180,24 @@ Latest default-branch history, still normalized against the frozen pinned baseli | Repository | Cohort | Latest ref | Current blended | Latest pinned | Highest pinned | Δ prev | Δ peak | | --------------------------------------------------------------------- | ---------- | ---------------- | --------------: | ------------: | -------------: | -----: | -----: | -| [`garrytan/gstack`](https://github.com/garrytan/gstack) | ai | `main@c6e6a21` | **4.59** | **4.77** | **6.37** | -0.64 | -1.60 | -| [`redwoodjs/agent-ci`](https://github.com/redwoodjs/agent-ci) | ai | `main@c61f27d` | **3.76** | **3.91** | **3.91** | +0.51 | 0.00 | -| [`jiayun/DevWorkbench`](https://github.com/jiayun/DevWorkbench) | ai | `main@ea50862` | **3.26** | **3.39** | **3.40** | 0.00 | -0.02 | -| [`robinebers/openusage`](https://github.com/robinebers/openusage) | ai | `main@06113d6` | **2.91** | **3.03** | **3.06** | +0.01 | -0.03 | -| [`openclaw/openclaw`](https://github.com/openclaw/openclaw) | ai | `main@1de5610` | **2.81** | **2.92** | **3.15** | -0.23 | -0.23 | -| [`FullAgent/fulling`](https://github.com/FullAgent/fulling) | ai | `main@d95060f` | **2.07** | **2.16** | **2.16** | 0.00 | 0.00 | -| [`emdash-cms/emdash`](https://github.com/emdash-cms/emdash) | ai | `main@a1dac00` | **1.94** | **2.01** | **2.17** | -0.16 | -0.16 | -| [`cloudflare/vinext`](https://github.com/cloudflare/vinext) | ai | `main@e81a621` | **1.85** | **1.93** | **1.99** | -0.06 | -0.07 | -| [`vitejs/vite`](https://github.com/vitejs/vite) | mature-oss | `main@bc5c6a7` | **1.46** | **1.52** | **1.52** | +0.02 | 0.00 | -| [`modem-dev/hunk`](https://github.com/modem-dev/hunk) | ai | `main@53242b4` | **1.46** | **1.51** | **1.51** | +0.44 | 0.00 | -| [`withastro/astro`](https://github.com/withastro/astro) | mature-oss | `main@7fe40bc` | **1.40** | **1.46** | **1.55** | 0.00 | -0.09 | -| [`pmndrs/zustand`](https://github.com/pmndrs/zustand) | mature-oss | `main@00f96a3` | **1.33** | **1.38** | **1.38** | 0.00 | -0.01 | -| [`payloadcms/payload`](https://github.com/payloadcms/payload) | mature-oss | `main@5afcef5` | **1.29** | **1.34** | **1.34** | +0.02 | 0.00 | -| [`umami-software/umami`](https://github.com/umami-software/umami) | mature-oss | `master@3a31ad3` | **1.00** | **1.04** | **1.04** | +0.00 | 0.00 | -| [`egoist/tsup`](https://github.com/egoist/tsup) | mature-oss | `main@b906f86` | **0.89** | **0.92** | **0.92** | 0.00 | 0.00 | -| [`sindresorhus/execa`](https://github.com/sindresorhus/execa) | mature-oss | `main@f3a2e84` | **0.85** | **0.89** | **0.89** | 0.00 | 0.00 | -| [`mikaelbr/node-notifier`](https://github.com/mikaelbr/node-notifier) | mature-oss | `master@b36c237` | **0.40** | **0.41** | **0.41** | 0.00 | 0.00 | -| [`vercel/hyper`](https://github.com/vercel/hyper) | mature-oss | `canary@2a7bb18` | **0.40** | **0.41** | **0.41** | 0.00 | 0.00 | +| [`garrytan/gstack`](https://github.com/garrytan/gstack) | ai | `main@ed1e4be` | **9.15** | **11.14** | **11.14** | +6.37 | 0.00 | +| [`FullAgent/fulling`](https://github.com/FullAgent/fulling) | ai | `main@d95060f` | **8.42** | **10.24** | **10.24** | +8.08 | 0.00 | +| [`redwoodjs/agent-ci`](https://github.com/redwoodjs/agent-ci) | ai | `main@76b46f9` | **7.83** | **9.53** | **9.53** | +5.61 | 0.00 | +| [`jiayun/DevWorkbench`](https://github.com/jiayun/DevWorkbench) | ai | `main@ea50862` | **7.39** | **8.99** | **8.99** | +5.60 | 0.00 | +| [`robinebers/openusage`](https://github.com/robinebers/openusage) | ai | `main@584d44d` | **5.27** | **6.41** | **6.41** | +3.39 | 0.00 | +| [`openclaw/openclaw`](https://github.com/openclaw/openclaw) | ai | `main@6b6dcaf` | **5.26** | **6.40** | **6.40** | +3.48 | 0.00 | +| [`emdash-cms/emdash`](https://github.com/emdash-cms/emdash) | ai | `main@3dd1a1f` | **4.15** | **5.06** | **5.06** | +3.04 | 0.00 | +| [`cloudflare/vinext`](https://github.com/cloudflare/vinext) | ai | `main@67a929b` | **3.06** | **3.73** | **3.73** | +1.80 | 0.00 | +| [`modem-dev/hunk`](https://github.com/modem-dev/hunk) | ai | `main@a6aa1cb` | **2.95** | **3.59** | **3.59** | +2.08 | 0.00 | +| [`vitejs/vite`](https://github.com/vitejs/vite) | mature-oss | `main@640202a` | **1.71** | **2.08** | **2.08** | +0.56 | 0.00 | +| [`withastro/astro`](https://github.com/withastro/astro) | mature-oss | `main@1058428` | **1.69** | **2.05** | **2.05** | +0.59 | 0.00 | +| [`egoist/tsup`](https://github.com/egoist/tsup) | mature-oss | `main@b906f86` | **1.25** | **1.52** | **1.52** | +0.60 | 0.00 | +| [`pmndrs/zustand`](https://github.com/pmndrs/zustand) | mature-oss | `main@95d3f33` | **1.12** | **1.36** | **1.38** | -0.02 | -0.02 | +| [`payloadcms/payload`](https://github.com/payloadcms/payload) | mature-oss | `main@0ceba02` | **1.00** | **1.22** | **1.34** | -0.13 | -0.13 | +| [`sindresorhus/execa`](https://github.com/sindresorhus/execa) | mature-oss | `main@f3a2e84` | **0.82** | **0.99** | **0.99** | +0.11 | 0.00 | +| [`mikaelbr/node-notifier`](https://github.com/mikaelbr/node-notifier) | mature-oss | `master@b36c237` | **0.78** | **0.95** | **0.95** | +0.53 | 0.00 | +| [`vercel/hyper`](https://github.com/vercel/hyper) | mature-oss | `canary@2a7bb18` | **0.74** | **0.90** | **0.90** | +0.49 | 0.00 | +| [`umami-software/umami`](https://github.com/umami-software/umami) | mature-oss | `master@c78ff36` | **0.70** | **0.85** | **1.04** | -0.19 | -0.19 | Legend: @@ -207,7 +207,7 @@ Legend: - `Δ prev` = latest pinned - previous week's pinned score - `Δ peak` = latest pinned - highest pinned score, so more negative means the repo is below its own historical high -For exact pinned SHAs and the full per-metric breakdowns, see the saved snapshot and pinned benchmark report. +For exact pinned SHAs, the current default-pack medians, and the full per-metric breakdowns, see the saved snapshot and pinned benchmark report. Full benchmark assets: diff --git a/benchmarks/history/known-ai-vs-solid-oss/agent-ci.jsonl b/benchmarks/history/known-ai-vs-solid-oss/agent-ci.jsonl index d0a2e6b..84c7319 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/agent-ci.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/agent-ci.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"agent-ci","repo":"redwoodjs/agent-ci","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"4326a2b517cf90155e92bea515a04d1dde0b4e8d","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":85,"directoryCount":22,"findingCount":25,"repoScore":79.35714285714288,"physicalLineCount":15268,"logicalLineCount":7373,"functionCount":199,"normalized":{"scorePerFile":0.9336134453781515,"scorePerKloc":10.763209393346381,"scorePerFunction":0.39877961234745163,"findingsPerFile":0.29411764705882354,"findingsPerKloc":3.3907500339075,"findingsPerFunction":0.12562814070351758}},"blended":{"vsCurrentCohort":3.304551337754753,"vsPinnedBaseline":3.4336696742651553},"ruleCounts":{"defensive.empty-catch":17,"defensive.error-obscuring":3,"defensive.error-swallowing":3,"structure.directory-fanout-hotspot":2}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"agent-ci","repo":"redwoodjs/agent-ci","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"be06e223d1f419565c7e5589bab0f789f1779f60","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":90,"directoryCount":23,"findingCount":26,"repoScore":81.35714285714288,"physicalLineCount":15656,"logicalLineCount":7673,"functionCount":204,"normalized":{"scorePerFile":0.9039682539682542,"scorePerKloc":10.60304220736907,"scorePerFunction":0.3988095238095239,"findingsPerFile":0.28888888888888886,"findingsPerKloc":3.388505147921282,"findingsPerFunction":0.12745098039215685}},"blended":{"vsCurrentCohort":3.277166214819975,"vsPinnedBaseline":3.4043912743913416},"ruleCounts":{"defensive.empty-catch":17,"defensive.error-obscuring":3,"defensive.error-swallowing":3,"structure.directory-fanout-hotspot":2,"structure.barrel-density":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"agent-ci","repo":"redwoodjs/agent-ci","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"c61f27d7734c74a9c0b9efa7bb833ff451c8b61c","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":114,"directoryCount":28,"findingCount":38,"repoScore":140.10000000000005,"physicalLineCount":22952,"logicalLineCount":11687,"functionCount":278,"normalized":{"scorePerFile":1.228947368421053,"scorePerKloc":11.987678617267054,"scorePerFunction":0.5039568345323743,"findingsPerFile":0.3333333333333333,"findingsPerKloc":3.2514759989732185,"findingsPerFunction":0.1366906474820144}},"blended":{"vsCurrentCohort":3.763892950592061,"vsPinnedBaseline":3.913159449141177},"ruleCounts":{"defensive.empty-catch":22,"tests.duplicate-mock-setup":6,"defensive.error-obscuring":5,"defensive.error-swallowing":3,"structure.barrel-density":1,"structure.pass-through-wrappers":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"agent-ci","repo":"redwoodjs/agent-ci","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"37f98a6c372bf909aeb5b8c7b1194708febccdce","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":137,"directoryCount":33,"findingCount":57,"repoScore":202.50000000000003,"physicalLineCount":28299,"logicalLineCount":13697,"functionCount":399,"normalized":{"scorePerFile":1.478102189781022,"scorePerKloc":14.7842593268599,"scorePerFunction":0.5075187969924813,"findingsPerFile":0.41605839416058393,"findingsPerKloc":4.161495217930934,"findingsPerFunction":0.14285714285714285}},"blended":{"vsCurrentCohort":4.321646110996529,"vsPinnedBaseline":4.556987923331088},"ruleCounts":{"defensive.empty-catch":23,"defensive.error-obscuring":9,"defensive.promise-default-fallbacks":8,"defensive.error-swallowing":6,"tests.duplicate-mock-setup":6,"structure.pass-through-wrappers":2,"api.generic-status-envelopes":1,"structure.barrel-density":1,"structure.directory-fanout-hotspot":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"agent-ci","repo":"redwoodjs/agent-ci","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"76b46f9929509a90355f34c0550dc20d29924aec","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":156,"directoryCount":42,"findingCount":60,"repoScore":207.50000000000003,"physicalLineCount":30109,"logicalLineCount":14645,"functionCount":483,"normalized":{"scorePerFile":1.3301282051282053,"scorePerKloc":14.16865824513486,"scorePerFunction":0.4296066252587992,"findingsPerFile":0.38461538461538464,"findingsPerKloc":4.09696142027996,"findingsPerFunction":0.12422360248447205}},"blended":{"vsCurrentCohort":7.828395917596652,"vsPinnedBaseline":9.52677143526095},"ruleCounts":{"defensive.empty-catch":25,"defensive.error-obscuring":11,"defensive.promise-default-fallbacks":9,"defensive.error-swallowing":6,"tests.duplicate-mock-setup":6,"structure.pass-through-wrappers":2,"api.generic-status-envelopes":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/astro.jsonl b/benchmarks/history/known-ai-vs-solid-oss/astro.jsonl index 0922e27..f2359fb 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/astro.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/astro.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"astro","repo":"withastro/astro","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"0d24e3b70c34e9a9b7edbed9a298a9a9da2e4b87","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":2769,"directoryCount":1136,"findingCount":265,"repoScore":742.3111471861466,"physicalLineCount":223917,"logicalLineCount":129814,"functionCount":4307,"normalized":{"scorePerFile":0.2680791430791429,"scorePerKloc":5.718267268446752,"scorePerFunction":0.1723499296926275,"findingsPerFile":0.09570241964608162,"findingsPerKloc":2.04138228542376,"findingsPerFunction":0.06152774553053169}},"blended":{"vsCurrentCohort":1.421120946836393,"vsPinnedBaseline":1.4766482344712326},"ruleCounts":{"structure.pass-through-wrappers":55,"defensive.empty-catch":45,"structure.duplicate-function-signatures":37,"defensive.error-obscuring":34,"structure.directory-fanout-hotspot":32,"structure.barrel-density":29,"defensive.async-noise":22,"defensive.error-swallowing":10,"structure.over-fragmentation":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"astro","repo":"withastro/astro","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"5557dcabbfe70ae06cd39d96f5b52102a740a148","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":2795,"directoryCount":1142,"findingCount":265,"repoScore":745.8540043290039,"physicalLineCount":226500,"logicalLineCount":131194,"functionCount":4358,"normalized":{"scorePerFile":0.26685295324830194,"scorePerKloc":5.685122828246749,"scorePerFunction":0.17114593949724735,"findingsPerFile":0.09481216457960644,"findingsPerKloc":2.0199094470783727,"findingsPerFunction":0.06080770995869665}},"blended":{"vsCurrentCohort":1.4098798004438529,"vsPinnedBaseline":1.4646136863202488},"ruleCounts":{"structure.pass-through-wrappers":55,"defensive.empty-catch":46,"structure.duplicate-function-signatures":37,"defensive.error-obscuring":34,"structure.directory-fanout-hotspot":32,"structure.barrel-density":29,"defensive.async-noise":21,"defensive.error-swallowing":10,"structure.over-fragmentation":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"astro","repo":"withastro/astro","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"7fe40bc7381d981dedad16625d89c00e31cd8fd0","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":2805,"directoryCount":1148,"findingCount":265,"repoScore":745.7111471861468,"physicalLineCount":227080,"logicalLineCount":131581,"functionCount":4367,"normalized":{"scorePerFile":0.26585067635869764,"scorePerKloc":5.667316308480304,"scorePerFunction":0.17076051000369746,"findingsPerFile":0.0944741532976827,"findingsPerKloc":2.0139685820901194,"findingsPerFunction":0.06068239065720174}},"blended":{"vsCurrentCohort":1.4045885875409714,"vsPinnedBaseline":1.46029102730651},"ruleCounts":{"structure.pass-through-wrappers":55,"defensive.empty-catch":46,"structure.duplicate-function-signatures":37,"defensive.error-obscuring":34,"structure.directory-fanout-hotspot":32,"structure.barrel-density":29,"defensive.async-noise":21,"defensive.error-swallowing":10,"structure.over-fragmentation":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"astro","repo":"withastro/astro","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"05e70f7751b15486d876bac26582fc712a24fd49","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":2764,"directoryCount":1111,"findingCount":282,"repoScore":783.7111471861468,"physicalLineCount":227465,"logicalLineCount":132317,"functionCount":4387,"normalized":{"scorePerFile":0.2835423832077232,"scorePerKloc":5.9229815306132,"scorePerFunction":0.17864398157878889,"findingsPerFile":0.1020260492040521,"findingsPerKloc":2.131245418200231,"findingsPerFunction":0.0642808297241851}},"blended":{"vsCurrentCohort":1.4667891604816459,"vsPinnedBaseline":1.546665395248319},"ruleCounts":{"structure.pass-through-wrappers":56,"defensive.empty-catch":46,"structure.duplicate-function-signatures":37,"defensive.error-obscuring":34,"structure.directory-fanout-hotspot":32,"structure.barrel-density":29,"defensive.async-noise":22,"defensive.promise-default-fallbacks":12,"defensive.error-swallowing":10,"defensive.stringified-unknown-errors":3,"structure.over-fragmentation":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"astro","repo":"withastro/astro","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"1058428df2d13878c6130787636dd1778273a934","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":2765,"directoryCount":1109,"findingCount":162,"repoScore":459.39999999999975,"physicalLineCount":227813,"logicalLineCount":132911,"functionCount":4391,"normalized":{"scorePerFile":0.1661482820976491,"scorePerKloc":3.456448299990217,"scorePerFunction":0.10462309268959229,"findingsPerFile":0.058589511754068714,"findingsPerKloc":1.2188607413983794,"findingsPerFunction":0.036893646094283764}},"blended":{"vsCurrentCohort":1.6862487641081452,"vsPinnedBaseline":2.052081515517092},"ruleCounts":{"structure.pass-through-wrappers":56,"defensive.empty-catch":47,"defensive.error-obscuring":34,"defensive.promise-default-fallbacks":12,"defensive.error-swallowing":10,"defensive.stringified-unknown-errors":3}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/devworkbench.jsonl b/benchmarks/history/known-ai-vs-solid-oss/devworkbench.jsonl index 72d6b1f..c4ab87b 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/devworkbench.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/devworkbench.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"devworkbench","repo":"jiayun/DevWorkbench","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"39921948fe542c046d16a64af884f05280b9b9b9","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":32,"directoryCount":7,"findingCount":14,"repoScore":32.13333333333333,"physicalLineCount":9360,"logicalLineCount":2957,"functionCount":146,"normalized":{"scorePerFile":1.0041666666666667,"scorePerKloc":10.866869575019727,"scorePerFunction":0.22009132420091324,"findingsPerFile":0.4375,"findingsPerKloc":4.734528238079134,"findingsPerFunction":0.0958904109589041}},"blended":{"vsCurrentCohort":3.27651444657068,"vsPinnedBaseline":3.404537301007842},"ruleCounts":{"defensive.error-swallowing":10,"defensive.empty-catch":1,"structure.barrel-density":1,"structure.directory-fanout-hotspot":1,"structure.pass-through-wrappers":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"devworkbench","repo":"jiayun/DevWorkbench","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"ea50862107c377b0cdd6e508073ad0330b367576","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":32,"directoryCount":7,"findingCount":14,"repoScore":32.13333333333333,"physicalLineCount":9408,"logicalLineCount":2986,"functionCount":147,"normalized":{"scorePerFile":1.0041666666666667,"scorePerKloc":10.761330654163874,"scorePerFunction":0.21859410430839002,"findingsPerFile":0.4375,"findingsPerKloc":4.688546550569323,"findingsPerFunction":0.09523809523809523}},"blended":{"vsCurrentCohort":3.2592382691916306,"vsPinnedBaseline":3.3857673360055234},"ruleCounts":{"defensive.error-swallowing":10,"defensive.empty-catch":1,"structure.barrel-density":1,"structure.directory-fanout-hotspot":1,"structure.pass-through-wrappers":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"devworkbench","repo":"jiayun/DevWorkbench","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"ea50862107c377b0cdd6e508073ad0330b367576","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":32,"directoryCount":7,"findingCount":14,"repoScore":32.13333333333333,"physicalLineCount":9408,"logicalLineCount":2986,"functionCount":147,"normalized":{"scorePerFile":1.0041666666666667,"scorePerKloc":10.761330654163874,"scorePerFunction":0.21859410430839002,"findingsPerFile":0.4375,"findingsPerKloc":4.688546550569323,"findingsPerFunction":0.09523809523809523}},"blended":{"vsCurrentCohort":3.256618079064708,"vsPinnedBaseline":3.3857673360055234},"ruleCounts":{"defensive.error-swallowing":10,"defensive.empty-catch":1,"structure.barrel-density":1,"structure.directory-fanout-hotspot":1,"structure.pass-through-wrappers":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"devworkbench","repo":"jiayun/DevWorkbench","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"ea50862107c377b0cdd6e508073ad0330b367576","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":32,"directoryCount":7,"findingCount":17,"repoScore":48.13333333333334,"physicalLineCount":9408,"logicalLineCount":2986,"functionCount":147,"normalized":{"scorePerFile":1.5041666666666669,"scorePerKloc":16.119669569100246,"scorePerFunction":0.32743764172335604,"findingsPerFile":0.53125,"findingsPerKloc":5.693235097119892,"findingsPerFunction":0.11564625850340136}},"blended":{"vsCurrentCohort":4.330459252026686,"vsPinnedBaseline":4.56628099736111},"ruleCounts":{"defensive.error-swallowing":10,"defensive.stringified-unknown-errors":2,"defensive.empty-catch":1,"defensive.promise-default-fallbacks":1,"structure.barrel-density":1,"structure.directory-fanout-hotspot":1,"structure.pass-through-wrappers":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"devworkbench","repo":"jiayun/DevWorkbench","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"ea50862107c377b0cdd6e508073ad0330b367576","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":32,"directoryCount":7,"findingCount":15,"repoScore":40.300000000000004,"physicalLineCount":9408,"logicalLineCount":2986,"functionCount":147,"normalized":{"scorePerFile":1.2593750000000001,"scorePerKloc":13.496316141995981,"scorePerFunction":0.2741496598639456,"findingsPerFile":0.46875,"findingsPerKloc":5.023442732752846,"findingsPerFunction":0.10204081632653061}},"blended":{"vsCurrentCohort":7.3878985235742185,"vsPinnedBaseline":8.990707848946045},"ruleCounts":{"defensive.error-swallowing":10,"defensive.stringified-unknown-errors":2,"defensive.empty-catch":1,"defensive.promise-default-fallbacks":1,"structure.pass-through-wrappers":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/emdash.jsonl b/benchmarks/history/known-ai-vs-solid-oss/emdash.jsonl index 5147c65..7da7cc7 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/emdash.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/emdash.jsonl @@ -1,3 +1,3 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"emdash","repo":"emdash-cms/emdash","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"5f448d1035073283fd7435d2f320d1f3c94898a0","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1072,"directoryCount":306,"findingCount":239,"repoScore":787.2525793650789,"physicalLineCount":257919,"logicalLineCount":120412,"functionCount":3513,"normalized":{"scorePerFile":0.7343774061241407,"scorePerKloc":6.537991058740648,"scorePerFunction":0.22409694829635038,"findingsPerFile":0.22294776119402984,"findingsPerKloc":1.9848520081055043,"findingsPerFunction":0.06803302021064617}},"blended":{"vsCurrentCohort":2.0933170174606843,"vsPinnedBaseline":2.1745830762415395},"ruleCounts":{"structure.duplicate-function-signatures":55,"defensive.empty-catch":40,"structure.barrel-density":34,"defensive.error-obscuring":27,"structure.pass-through-wrappers":27,"tests.duplicate-mock-setup":21,"structure.directory-fanout-hotspot":17,"defensive.error-swallowing":13,"defensive.async-noise":5}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"emdash","repo":"emdash-cms/emdash","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"a1dac004da667b101f5a3f6287c8f8ccaf2e6863","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1132,"directoryCount":317,"findingCount":243,"repoScore":795.1484126984125,"physicalLineCount":304059,"logicalLineCount":143660,"functionCount":3658,"normalized":{"scorePerFile":0.7024279264120251,"scorePerKloc":5.5349325678575285,"scorePerFunction":0.2173724474298558,"findingsPerFile":0.2146643109540636,"findingsPerKloc":1.6914938048169288,"findingsPerFunction":0.06642974302897758}},"blended":{"vsCurrentCohort":1.9362549120163848,"vsPinnedBaseline":2.0130418968772985},"ruleCounts":{"structure.duplicate-function-signatures":55,"defensive.empty-catch":39,"structure.barrel-density":34,"defensive.error-obscuring":28,"structure.pass-through-wrappers":28,"tests.duplicate-mock-setup":24,"structure.directory-fanout-hotspot":17,"defensive.error-swallowing":13,"defensive.async-noise":5}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"emdash","repo":"emdash-cms/emdash","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"f7f4814182e1ad249a9ea15951a1fb5ca4362411","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":1192,"directoryCount":337,"findingCount":371,"repoScore":1360.345634920635,"physicalLineCount":326832,"logicalLineCount":155506,"functionCount":3817,"normalized":{"scorePerFile":1.1412295594971769,"scorePerKloc":8.74786590176993,"scorePerFunction":0.35639131121840056,"findingsPerFile":0.311241610738255,"findingsPerKloc":2.385760034982573,"findingsPerFunction":0.09719675137542573}},"blended":{"vsCurrentCohort":2.9120710387841258,"vsPinnedBaseline":3.07065229655315},"ruleCounts":{"structure.duplicate-function-signatures":61,"defensive.empty-catch":41,"defensive.promise-default-fallbacks":40,"api.generic-status-envelopes":39,"structure.barrel-density":35,"defensive.error-obscuring":30,"structure.pass-through-wrappers":29,"tests.duplicate-mock-setup":28,"defensive.stringified-unknown-errors":21,"structure.directory-fanout-hotspot":17,"defensive.error-swallowing":13,"types.generic-record-casts":12,"defensive.async-noise":5}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"emdash","repo":"emdash-cms/emdash","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"3dd1a1f70ec55afe851138ea15ae01eb805d8673","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":1218,"directoryCount":340,"findingCount":266,"repoScore":1027.2999999999997,"physicalLineCount":333193,"logicalLineCount":158986,"functionCount":3919,"normalized":{"scorePerFile":0.8434318555008208,"scorePerKloc":6.461575233039386,"scorePerFunction":0.26213319724419487,"findingsPerFile":0.21839080459770116,"findingsPerKloc":1.6731032921137712,"findingsPerFunction":0.06787445776983925}},"blended":{"vsCurrentCohort":4.154997740392929,"vsPinnedBaseline":5.056427166358941},"ruleCounts":{"api.generic-status-envelopes":43,"defensive.empty-catch":41,"defensive.promise-default-fallbacks":40,"structure.pass-through-wrappers":33,"tests.duplicate-mock-setup":31,"defensive.error-obscuring":30,"defensive.stringified-unknown-errors":22,"defensive.error-swallowing":13,"types.generic-record-casts":13}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/execa.jsonl b/benchmarks/history/known-ai-vs-solid-oss/execa.jsonl index c96371f..73beb39 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/execa.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/execa.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"execa","repo":"sindresorhus/execa","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"f3a2e8481a1e9138de3895827895c834078b9456","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":581,"directoryCount":46,"findingCount":28,"repoScore":99.01486212489861,"physicalLineCount":36103,"logicalLineCount":20432,"functionCount":1008,"normalized":{"scorePerFile":0.17042144944044513,"scorePerKloc":4.846068036653222,"scorePerFunction":0.09822902988581211,"findingsPerFile":0.04819277108433735,"findingsPerKloc":1.370399373531715,"findingsPerFunction":0.027777777777777776}},"blended":{"vsCurrentCohort":0.8532997014182334,"vsPinnedBaseline":0.8866405779036939},"ruleCounts":{"defensive.empty-catch":11,"structure.directory-fanout-hotspot":7,"structure.duplicate-function-signatures":6,"structure.over-fragmentation":2,"defensive.error-obscuring":1,"structure.barrel-density":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"execa","repo":"sindresorhus/execa","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"f3a2e8481a1e9138de3895827895c834078b9456","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":581,"directoryCount":46,"findingCount":28,"repoScore":99.01486212489861,"physicalLineCount":36103,"logicalLineCount":20432,"functionCount":1008,"normalized":{"scorePerFile":0.17042144944044513,"scorePerKloc":4.846068036653222,"scorePerFunction":0.09822902988581211,"findingsPerFile":0.04819277108433735,"findingsPerKloc":1.370399373531715,"findingsPerFunction":0.027777777777777776}},"blended":{"vsCurrentCohort":0.853506049216959,"vsPinnedBaseline":0.8866405779036939},"ruleCounts":{"defensive.empty-catch":11,"structure.directory-fanout-hotspot":7,"structure.duplicate-function-signatures":6,"structure.over-fragmentation":2,"defensive.error-obscuring":1,"structure.barrel-density":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"execa","repo":"sindresorhus/execa","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"f3a2e8481a1e9138de3895827895c834078b9456","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":581,"directoryCount":46,"findingCount":28,"repoScore":99.01486212489861,"physicalLineCount":36103,"logicalLineCount":20432,"functionCount":1008,"normalized":{"scorePerFile":0.17042144944044513,"scorePerKloc":4.846068036653222,"scorePerFunction":0.09822902988581211,"findingsPerFile":0.04819277108433735,"findingsPerKloc":1.370399373531715,"findingsPerFunction":0.027777777777777776}},"blended":{"vsCurrentCohort":0.8528198925328754,"vsPinnedBaseline":0.8866405779036939},"ruleCounts":{"defensive.empty-catch":11,"structure.directory-fanout-hotspot":7,"structure.duplicate-function-signatures":6,"structure.over-fragmentation":2,"defensive.error-obscuring":1,"structure.barrel-density":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"execa","repo":"sindresorhus/execa","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"f3a2e8481a1e9138de3895827895c834078b9456","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":581,"directoryCount":46,"findingCount":29,"repoScore":101.01486212489863,"physicalLineCount":36103,"logicalLineCount":20432,"functionCount":1008,"normalized":{"scorePerFile":0.1738637902321835,"scorePerKloc":4.943953706191202,"scorePerFunction":0.10021315686993912,"findingsPerFile":0.04991394148020654,"findingsPerKloc":1.4193422083007048,"findingsPerFunction":0.028769841269841268}},"blended":{"vsCurrentCohort":0.8643335159262805,"vsPinnedBaseline":0.9114021122146257},"ruleCounts":{"defensive.empty-catch":11,"structure.directory-fanout-hotspot":7,"structure.duplicate-function-signatures":6,"structure.over-fragmentation":2,"defensive.error-obscuring":1,"defensive.promise-default-fallbacks":1,"structure.barrel-density":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"execa","repo":"sindresorhus/execa","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"f3a2e8481a1e9138de3895827895c834078b9456","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":581,"directoryCount":46,"findingCount":13,"repoScore":50.9,"physicalLineCount":36103,"logicalLineCount":20432,"functionCount":1008,"normalized":{"scorePerFile":0.08760757314974182,"scorePerKloc":2.491190289741582,"scorePerFunction":0.05049603174603175,"findingsPerFile":0.022375215146299483,"findingsPerKloc":0.6362568519968677,"findingsPerFunction":0.012896825396825396}},"blended":{"vsCurrentCohort":0.8153733768021222,"vsPinnedBaseline":0.992269154109861},"ruleCounts":{"defensive.empty-catch":11,"defensive.error-obscuring":1,"defensive.promise-default-fallbacks":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/fulling.jsonl b/benchmarks/history/known-ai-vs-solid-oss/fulling.jsonl index 2db98b1..b5d249f 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/fulling.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/fulling.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"fulling","repo":"FullAgent/fulling","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"5cfc59ad3d3b33f58b6579dd8392bcb8ffb18f95","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":205,"directoryCount":78,"findingCount":33,"repoScore":111.09166666666668,"physicalLineCount":25166,"logicalLineCount":10751,"functionCount":571,"normalized":{"scorePerFile":0.5419105691056911,"scorePerKloc":10.33314730412675,"scorePerFunction":0.19455633391710453,"findingsPerFile":0.16097560975609757,"findingsPerKloc":3.0694819086596596,"findingsPerFunction":0.05779334500875657}},"blended":{"vsCurrentCohort":2.078769486475488,"vsPinnedBaseline":2.1599929963104616},"ruleCounts":{"defensive.error-swallowing":11,"defensive.error-obscuring":5,"structure.barrel-density":4,"structure.pass-through-wrappers":4,"defensive.async-noise":3,"defensive.empty-catch":3,"structure.directory-fanout-hotspot":3}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"fulling","repo":"FullAgent/fulling","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"d95060f8421b5888564fc8517c1fe99ded463985","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":219,"directoryCount":78,"findingCount":36,"repoScore":115.59166666666668,"physicalLineCount":26787,"logicalLineCount":12154,"functionCount":574,"normalized":{"scorePerFile":0.5278158295281584,"scorePerKloc":9.510586363885691,"scorePerFunction":0.20137921022067368,"findingsPerFile":0.1643835616438356,"findingsPerKloc":2.96198782293895,"findingsPerFunction":0.0627177700348432}},"blended":{"vsCurrentCohort":2.076583230796868,"vsPinnedBaseline":2.157199656063399},"ruleCounts":{"defensive.error-swallowing":11,"defensive.error-obscuring":5,"structure.barrel-density":4,"structure.pass-through-wrappers":4,"defensive.async-noise":3,"defensive.empty-catch":3,"structure.directory-fanout-hotspot":3,"tests.duplicate-mock-setup":3}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"fulling","repo":"FullAgent/fulling","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"d95060f8421b5888564fc8517c1fe99ded463985","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":219,"directoryCount":78,"findingCount":36,"repoScore":115.59166666666668,"physicalLineCount":26787,"logicalLineCount":12154,"functionCount":574,"normalized":{"scorePerFile":0.5278158295281584,"scorePerKloc":9.510586363885691,"scorePerFunction":0.20137921022067368,"findingsPerFile":0.1643835616438356,"findingsPerKloc":2.96198782293895,"findingsPerFunction":0.0627177700348432}},"blended":{"vsCurrentCohort":2.074913809162218,"vsPinnedBaseline":2.157199656063399},"ruleCounts":{"defensive.error-swallowing":11,"defensive.error-obscuring":5,"structure.barrel-density":4,"structure.pass-through-wrappers":4,"defensive.async-noise":3,"defensive.empty-catch":3,"structure.directory-fanout-hotspot":3,"tests.duplicate-mock-setup":3}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"fulling","repo":"FullAgent/fulling","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"d95060f8421b5888564fc8517c1fe99ded463985","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":219,"directoryCount":78,"findingCount":74,"repoScore":303.59166666666664,"physicalLineCount":26787,"logicalLineCount":12154,"functionCount":574,"normalized":{"scorePerFile":1.3862633181126331,"scorePerKloc":24.978744994789093,"scorePerFunction":0.5289053426248548,"findingsPerFile":0.3378995433789954,"findingsPerKloc":6.088530524930064,"findingsPerFunction":0.1289198606271777}},"blended":{"vsCurrentCohort":4.7534391115322565,"vsPinnedBaseline":5.012294868481783},"ruleCounts":{"api.generic-status-envelopes":31,"defensive.error-swallowing":11,"defensive.stringified-unknown-errors":6,"defensive.error-obscuring":5,"structure.barrel-density":4,"structure.pass-through-wrappers":4,"defensive.async-noise":3,"defensive.empty-catch":3,"structure.directory-fanout-hotspot":3,"tests.duplicate-mock-setup":3,"defensive.promise-default-fallbacks":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"fulling","repo":"FullAgent/fulling","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"d95060f8421b5888564fc8517c1fe99ded463985","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":219,"directoryCount":78,"findingCount":64,"repoScore":279.29999999999995,"physicalLineCount":26787,"logicalLineCount":12154,"functionCount":574,"normalized":{"scorePerFile":1.2753424657534245,"scorePerKloc":22.980088859634684,"scorePerFunction":0.48658536585365847,"findingsPerFile":0.2922374429223744,"findingsPerKloc":5.265756129669245,"findingsPerFunction":0.11149825783972125}},"blended":{"vsCurrentCohort":8.416060514231665,"vsPinnedBaseline":10.241930243229788},"ruleCounts":{"api.generic-status-envelopes":31,"defensive.error-swallowing":11,"defensive.stringified-unknown-errors":6,"defensive.error-obscuring":5,"structure.pass-through-wrappers":4,"defensive.empty-catch":3,"tests.duplicate-mock-setup":3,"defensive.promise-default-fallbacks":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/gstack.jsonl b/benchmarks/history/known-ai-vs-solid-oss/gstack.jsonl index 8ce0970..1477727 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/gstack.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/gstack.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"gstack","repo":"garrytan/gstack","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"7911b7b974a1cef2794473a77ea93d0ac351b8c2","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":144,"directoryCount":17,"findingCount":72,"repoScore":320.46666666666664,"physicalLineCount":46801,"logicalLineCount":13966,"functionCount":663,"normalized":{"scorePerFile":2.225462962962963,"scorePerKloc":22.946202682705618,"scorePerFunction":0.48335847159376566,"findingsPerFile":0.5,"findingsPerKloc":5.155377344980668,"findingsPerFunction":0.1085972850678733}},"blended":{"vsCurrentCohort":5.11559977530993,"vsPinnedBaseline":5.315480989347836},"ruleCounts":{"defensive.empty-catch":47,"defensive.error-obscuring":13,"defensive.error-swallowing":5,"structure.pass-through-wrappers":5,"defensive.async-noise":1,"structure.directory-fanout-hotspot":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"gstack","repo":"garrytan/gstack","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"03973c2fabfb4988a2a4c2fefc44a7e280804884","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":171,"directoryCount":19,"findingCount":88,"repoScore":402.2999999999998,"physicalLineCount":59303,"logicalLineCount":17808,"functionCount":787,"normalized":{"scorePerFile":2.352631578947367,"scorePerKloc":22.5909703504043,"scorePerFunction":0.5111817026683606,"findingsPerFile":0.5146198830409356,"findingsPerKloc":4.941599281221923,"findingsPerFunction":0.11181702668360864}},"blended":{"vsCurrentCohort":5.212918457407813,"vsPinnedBaseline":5.415292648343023},"ruleCounts":{"defensive.empty-catch":54,"defensive.error-obscuring":19,"defensive.error-swallowing":8,"structure.pass-through-wrappers":5,"defensive.async-noise":1,"structure.directory-fanout-hotspot":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"gstack","repo":"garrytan/gstack","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"c6e6a21d1a9a58e771403260ff6a134898f2dd02","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":186,"directoryCount":19,"findingCount":91,"repoScore":364.1533333333332,"physicalLineCount":64888,"logicalLineCount":19484,"functionCount":875,"normalized":{"scorePerFile":1.9578136200716838,"scorePerKloc":18.689865188530753,"scorePerFunction":0.41617523809523793,"findingsPerFile":0.489247311827957,"findingsPerKloc":4.670498870868404,"findingsPerFunction":0.104}},"blended":{"vsCurrentCohort":4.590293228472618,"vsPinnedBaseline":4.772332677129107},"ruleCounts":{"defensive.empty-catch":52,"defensive.error-obscuring":19,"structure.pass-through-wrappers":9,"defensive.error-swallowing":8,"structure.directory-fanout-hotspot":2,"defensive.async-noise":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"gstack","repo":"garrytan/gstack","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"d0782c4c4da2e71e3bc714317d5da5b3ce1072ad","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":273,"directoryCount":24,"findingCount":124,"repoScore":508.0666666666663,"physicalLineCount":79937,"logicalLineCount":25744,"functionCount":1091,"normalized":{"scorePerFile":1.8610500610500598,"scorePerKloc":19.73534286306193,"scorePerFunction":0.4656889703635805,"findingsPerFile":0.4542124542124542,"findingsPerKloc":4.816656308266004,"findingsPerFunction":0.11365719523373052}},"blended":{"vsCurrentCohort":4.64931478116071,"vsPinnedBaseline":4.902500289323458},"ruleCounts":{"defensive.empty-catch":66,"defensive.error-obscuring":24,"structure.pass-through-wrappers":11,"defensive.error-swallowing":8,"defensive.promise-default-fallbacks":7,"structure.directory-fanout-hotspot":2,"types.generic-record-casts":2,"api.generic-status-envelopes":1,"comments.placeholder-comments":1,"defensive.async-noise":1,"defensive.stringified-unknown-errors":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"gstack","repo":"garrytan/gstack","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"ed1e4be2f68bf977f1fa485eba94d89dbef5255c","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":331,"directoryCount":24,"findingCount":148,"repoScore":588.9999999999997,"physicalLineCount":93480,"logicalLineCount":30907,"functionCount":1250,"normalized":{"scorePerFile":1.7794561933534734,"scorePerKloc":19.05717151454362,"scorePerFunction":0.47119999999999973,"findingsPerFile":0.4471299093655589,"findingsPerKloc":4.788559226065293,"findingsPerFunction":0.1184}},"blended":{"vsCurrentCohort":9.15374254041419,"vsPinnedBaseline":11.139652858349983},"ruleCounts":{"defensive.empty-catch":85,"defensive.error-obscuring":31,"structure.pass-through-wrappers":11,"defensive.error-swallowing":9,"defensive.promise-default-fallbacks":8,"defensive.stringified-unknown-errors":2,"api.generic-status-envelopes":1,"types.generic-record-casts":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/hunk.jsonl b/benchmarks/history/known-ai-vs-solid-oss/hunk.jsonl index f0192ac..9e327a0 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/hunk.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/hunk.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"hunk","repo":"modem-dev/hunk","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"bbfacbd79d2562f6c2bab8964da90443cbe29197","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":146,"directoryCount":32,"findingCount":17,"repoScore":50.4,"physicalLineCount":27276,"logicalLineCount":11022,"functionCount":632,"normalized":{"scorePerFile":0.34520547945205476,"scorePerKloc":4.57267283614589,"scorePerFunction":0.07974683544303797,"findingsPerFile":0.11643835616438356,"findingsPerKloc":1.5423698058428597,"findingsPerFunction":0.02689873417721519}},"blended":{"vsCurrentCohort":1.078908251493315,"vsPinnedBaseline":1.1210643036897423},"ruleCounts":{"defensive.error-obscuring":6,"defensive.empty-catch":4,"structure.pass-through-wrappers":4,"defensive.async-noise":1,"defensive.error-swallowing":1,"structure.directory-fanout-hotspot":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"hunk","repo":"modem-dev/hunk","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"90366239381b642fde80aa5b3a350a291eb41282","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":158,"directoryCount":33,"findingCount":18,"repoScore":53.37527472527472,"physicalLineCount":30250,"logicalLineCount":12178,"functionCount":704,"normalized":{"scorePerFile":0.33781819446376404,"scorePerKloc":4.382926155795263,"scorePerFunction":0.07581715159840159,"findingsPerFile":0.11392405063291139,"findingsPerKloc":1.478075217605518,"findingsPerFunction":0.02556818181818182}},"blended":{"vsCurrentCohort":1.0386382637379339,"vsPinnedBaseline":1.078959933838033},"ruleCounts":{"defensive.error-obscuring":6,"defensive.empty-catch":4,"structure.pass-through-wrappers":4,"structure.directory-fanout-hotspot":2,"defensive.async-noise":1,"defensive.error-swallowing":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"hunk","repo":"modem-dev/hunk","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"53242b4b45afc3ee728f2ee10054c4cec83314c8","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":186,"directoryCount":38,"findingCount":31,"repoScore":88.89960317460319,"physicalLineCount":37128,"logicalLineCount":15245,"functionCount":840,"normalized":{"scorePerFile":0.47795485577743646,"scorePerKloc":5.831394107878202,"scorePerFunction":0.10583286092214665,"findingsPerFile":0.16666666666666666,"findingsPerKloc":2.0334535913414236,"findingsPerFunction":0.036904761904761905}},"blended":{"vsCurrentCohort":1.4562462925417925,"vsPinnedBaseline":1.5139973465611831},"ruleCounts":{"defensive.error-obscuring":9,"defensive.empty-catch":6,"structure.pass-through-wrappers":6,"structure.directory-fanout-hotspot":4,"structure.duplicate-function-signatures":3,"defensive.async-noise":1,"defensive.error-swallowing":1,"structure.barrel-density":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"hunk","repo":"modem-dev/hunk","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"a6aa1cb8791fa90c71c68fc41a2eee77752c3e6a","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":212,"directoryCount":43,"findingCount":47,"repoScore":126.82689075630253,"physicalLineCount":40479,"logicalLineCount":17410,"functionCount":940,"normalized":{"scorePerFile":0.598240050737276,"scorePerKloc":7.284715149701467,"scorePerFunction":0.1349222242088325,"findingsPerFile":0.22169811320754718,"findingsPerKloc":2.6995979322228605,"findingsPerFunction":0.05}},"blended":{"vsCurrentCohort":1.8628276339934124,"vsPinnedBaseline":1.9642707462221969},"ruleCounts":{"defensive.error-obscuring":10,"defensive.empty-catch":7,"structure.pass-through-wrappers":7,"defensive.stringified-unknown-errors":5,"defensive.promise-default-fallbacks":3,"structure.barrel-density":3,"structure.directory-fanout-hotspot":3,"structure.duplicate-function-signatures":3,"types.generic-record-casts":3,"api.generic-status-envelopes":1,"defensive.async-noise":1,"defensive.error-swallowing":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"hunk","repo":"modem-dev/hunk","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"a6aa1cb8791fa90c71c68fc41a2eee77752c3e6a","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":212,"directoryCount":43,"findingCount":37,"repoScore":102.60000000000001,"physicalLineCount":40479,"logicalLineCount":17410,"functionCount":940,"normalized":{"scorePerFile":0.48396226415094346,"scorePerKloc":5.893164847788627,"scorePerFunction":0.10914893617021278,"findingsPerFile":0.17452830188679244,"findingsPerKloc":2.1252153934520392,"findingsPerFunction":0.039361702127659576}},"blended":{"vsCurrentCohort":2.9507258067064672,"vsPinnedBaseline":3.5908876638994305},"ruleCounts":{"defensive.error-obscuring":10,"defensive.empty-catch":7,"structure.pass-through-wrappers":7,"defensive.stringified-unknown-errors":5,"defensive.promise-default-fallbacks":3,"types.generic-record-casts":3,"api.generic-status-envelopes":1,"defensive.error-swallowing":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/hyper.jsonl b/benchmarks/history/known-ai-vs-solid-oss/hyper.jsonl index 615dace..639ce99 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/hyper.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/hyper.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"hyper","repo":"vercel/hyper","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"canary","ref":"2a7bb18259d975f27b30b502af1be7576f6f5656","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":113,"directoryCount":21,"findingCount":18,"repoScore":73.10000000000001,"physicalLineCount":162735,"logicalLineCount":65075,"functionCount":5354,"normalized":{"scorePerFile":0.6469026548672567,"scorePerKloc":1.1233192470226663,"scorePerFunction":0.013653343294732912,"findingsPerFile":0.1592920353982301,"findingsPerKloc":0.27660391855551286,"findingsPerFunction":0.0033619723571161747}},"blended":{"vsCurrentCohort":0.3952387446813107,"vsPinnedBaseline":0.4106818605605101},"ruleCounts":{"defensive.error-swallowing":8,"structure.pass-through-wrappers":5,"defensive.empty-catch":3,"defensive.async-noise":1,"defensive.error-obscuring":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"hyper","repo":"vercel/hyper","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"canary","ref":"2a7bb18259d975f27b30b502af1be7576f6f5656","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":113,"directoryCount":21,"findingCount":18,"repoScore":73.10000000000001,"physicalLineCount":162735,"logicalLineCount":65075,"functionCount":5354,"normalized":{"scorePerFile":0.6469026548672567,"scorePerKloc":1.1233192470226663,"scorePerFunction":0.013653343294732912,"findingsPerFile":0.1592920353982301,"findingsPerKloc":0.27660391855551286,"findingsPerFunction":0.0033619723571161747}},"blended":{"vsCurrentCohort":0.39533432264155205,"vsPinnedBaseline":0.4106818605605101},"ruleCounts":{"defensive.error-swallowing":8,"structure.pass-through-wrappers":5,"defensive.empty-catch":3,"defensive.async-noise":1,"defensive.error-obscuring":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"hyper","repo":"vercel/hyper","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"canary","ref":"2a7bb18259d975f27b30b502af1be7576f6f5656","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":113,"directoryCount":21,"findingCount":18,"repoScore":73.10000000000001,"physicalLineCount":162735,"logicalLineCount":65075,"functionCount":5354,"normalized":{"scorePerFile":0.6469026548672567,"scorePerKloc":1.1233192470226663,"scorePerFunction":0.013653343294732912,"findingsPerFile":0.1592920353982301,"findingsPerKloc":0.27660391855551286,"findingsPerFunction":0.0033619723571161747}},"blended":{"vsCurrentCohort":0.39501650264698135,"vsPinnedBaseline":0.4106818605605101},"ruleCounts":{"defensive.error-swallowing":8,"structure.pass-through-wrappers":5,"defensive.empty-catch":3,"defensive.async-noise":1,"defensive.error-obscuring":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"hyper","repo":"vercel/hyper","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"canary","ref":"2a7bb18259d975f27b30b502af1be7576f6f5656","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":113,"directoryCount":21,"findingCount":18,"repoScore":73.10000000000001,"physicalLineCount":162735,"logicalLineCount":65075,"functionCount":5354,"normalized":{"scorePerFile":0.6469026548672567,"scorePerKloc":1.1233192470226663,"scorePerFunction":0.013653343294732912,"findingsPerFile":0.1592920353982301,"findingsPerKloc":0.27660391855551286,"findingsPerFunction":0.0033619723571161747}},"blended":{"vsCurrentCohort":0.38947254094340006,"vsPinnedBaseline":0.4106818605605101},"ruleCounts":{"defensive.error-swallowing":8,"structure.pass-through-wrappers":5,"defensive.empty-catch":3,"defensive.async-noise":1,"defensive.error-obscuring":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"hyper","repo":"vercel/hyper","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"canary","ref":"2a7bb18259d975f27b30b502af1be7576f6f5656","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":113,"directoryCount":21,"findingCount":17,"repoScore":71.60000000000001,"physicalLineCount":162735,"logicalLineCount":65075,"functionCount":5354,"normalized":{"scorePerFile":0.6336283185840709,"scorePerKloc":1.1002689204763736,"scorePerFunction":0.013373178931639897,"findingsPerFile":0.1504424778761062,"findingsPerKloc":0.2612370341913177,"findingsPerFunction":0.003175196115054165}},"blended":{"vsCurrentCohort":0.7435310633443125,"vsPinnedBaseline":0.9048406046474513},"ruleCounts":{"defensive.error-swallowing":8,"structure.pass-through-wrappers":5,"defensive.empty-catch":3,"defensive.error-obscuring":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/latest.json b/benchmarks/history/known-ai-vs-solid-oss/latest.json index bcea8ca..254db6e 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/latest.json +++ b/benchmarks/history/known-ai-vs-solid-oss/latest.json @@ -2,25 +2,25 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "generatedAt": "2026-04-20T12:22:33.984Z", + "generatedAt": "2026-04-26T18:00:48.765Z", "baseline": { "snapshotPath": "benchmarks/results/known-ai-vs-solid-oss.json", - "generatedAt": "2026-04-17T23:32:37.950Z", + "generatedAt": "2026-04-26T18:00:48.544Z", "analyzerVersion": "0.3.0", "matureOssMedians": { - "scorePerFile": 0.24054860905143094, - "scorePerKloc": 4.04172676403917, - "scorePerFunction": 0.09832657609225284, - "findingsPerFile": 0.0824279641001417, - "findingsPerKloc": 1.3849646020508588, - "findingsPerFunction": 0.03732162458836443 + "scorePerFile": 0.12180634662327097, + "scorePerKloc": 1.4774722059684027, + "scorePerFunction": 0.05054617676266137, + "findingsPerFile": 0.04231082180634662, + "findingsPerKloc": 0.5636978579481398, + "findingsPerFunction": 0.023809523809523808 }, - "matureOssRawBlendedMedian": 0.9536302244152335 + "matureOssRawBlendedMedian": 0.8620468664945657 }, "analyzers": [ { "version": "0.3.0", - "commit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "commit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "repoCount": 18 } ], @@ -28,36 +28,256 @@ "explicit-ai": { "repoCount": 9, "medians": { - "scorePerFile": 1.3862633181126331, - "scorePerKloc": 13.003299080885625, - "scorePerFunction": 0.35639131121840056, - "findingsPerFile": 0.36363636363636365, - "findingsPerKloc": 3.87710127101271, - "findingsPerFunction": 0.09719675137542573 - }, - "blendedScoreMedian": 3.5098116648847677 + "scorePerFile": 1.2593750000000001, + "scorePerKloc": 10.14728496530615, + "scorePerFunction": 0.2741496598639456, + "findingsPerFile": 0.2922374429223744, + "findingsPerKloc": 2.852620148173585, + "findingsPerFunction": 0.07950530035335689 + }, + "blendedScoreMedian": 5.271326639649764 }, "mature-oss": { "repoCount": 9, "medians": { - "scorePerFile": 0.2703335161932626, - "scorePerKloc": 3.605708191559595, - "scorePerFunction": 0.10021315686993912, - "findingsPerFile": 0.08680555555555555, - "findingsPerKloc": 1.4193422083007048, - "findingsPerFunction": 0.03836317135549872 + "scorePerFile": 0.14583333333333334, + "scorePerKloc": 1.7259587821731395, + "scorePerFunction": 0.05049603174603175, + "findingsPerFile": 0.049930651872399444, + "findingsPerKloc": 0.6034820916689297, + "findingsPerFunction": 0.023391812865497075 }, "blendedScoreMedian": 1 } }, "repos": [ + { + "id": "gstack", + "repo": "garrytan/gstack", + "cohort": "explicit-ai", + "pointCount": 5, + "firstRecordedAt": "2026-03-23T12:00:00Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", + "first": { + "schemaVersion": 1, + "benchmarkSetId": "known-ai-vs-solid-oss", + "benchmarkSetName": "Known AI repos vs older solid OSS repos", + "recordedAt": "2026-03-23T12:00:00Z", + "periodStart": "2026-03-23", + "repoId": "gstack", + "repo": "garrytan/gstack", + "cohort": "explicit-ai", + "scanMode": "default-branch-as-of-recorded-at", + "defaultBranch": "main", + "ref": "7fbf68bb3f253ef799f38862fb1cb0b62d756a64", + "analyzerVersion": "0.3.0", + "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", + "summary": { + "fileCount": 78, + "directoryCount": 10, + "findingCount": 47, + "repoScore": 205.10000000000005, + "physicalLineCount": 30473, + "logicalLineCount": 9213, + "functionCount": 291, + "normalized": { + "scorePerFile": 2.6294871794871804, + "scorePerKloc": 22.26202105720179, + "scorePerFunction": 0.704810996563574, + "findingsPerFile": 0.6025641025641025, + "findingsPerKloc": 5.101487029197873, + "findingsPerFunction": 0.16151202749140894 + } + }, + "blended": { + "vsCurrentCohort": 6.101414127021402, + "vsPinnedBaseline": 6.370934113832667 + }, + "ruleCounts": { + "defensive.empty-catch": 30, + "defensive.error-obscuring": 11, + "defensive.error-swallowing": 3, + "structure.pass-through-wrappers": 2, + "defensive.async-noise": 1 + } + }, + "previous": { + "schemaVersion": 1, + "benchmarkSetId": "known-ai-vs-solid-oss", + "benchmarkSetName": "Known AI repos vs older solid OSS repos", + "recordedAt": "2026-04-13T12:00:00Z", + "periodStart": "2026-04-13", + "repoId": "gstack", + "repo": "garrytan/gstack", + "cohort": "explicit-ai", + "scanMode": "default-branch-as-of-recorded-at", + "defaultBranch": "main", + "ref": "c6e6a21d1a9a58e771403260ff6a134898f2dd02", + "analyzerVersion": "0.3.0", + "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", + "summary": { + "fileCount": 186, + "directoryCount": 19, + "findingCount": 91, + "repoScore": 364.1533333333332, + "physicalLineCount": 64888, + "logicalLineCount": 19484, + "functionCount": 875, + "normalized": { + "scorePerFile": 1.9578136200716838, + "scorePerKloc": 18.689865188530753, + "scorePerFunction": 0.41617523809523793, + "findingsPerFile": 0.489247311827957, + "findingsPerKloc": 4.670498870868404, + "findingsPerFunction": 0.104 + } + }, + "blended": { + "vsCurrentCohort": 4.590293228472618, + "vsPinnedBaseline": 4.772332677129107 + }, + "ruleCounts": { + "defensive.empty-catch": 52, + "defensive.error-obscuring": 19, + "structure.pass-through-wrappers": 9, + "defensive.error-swallowing": 8, + "structure.directory-fanout-hotspot": 2, + "defensive.async-noise": 1 + } + }, + "latest": { + "schemaVersion": 1, + "benchmarkSetId": "known-ai-vs-solid-oss", + "benchmarkSetName": "Known AI repos vs older solid OSS repos", + "recordedAt": "2026-04-26T18:00:48.765Z", + "periodStart": "2026-04-20", + "repoId": "gstack", + "repo": "garrytan/gstack", + "cohort": "explicit-ai", + "scanMode": "default-branch-as-of-recorded-at", + "defaultBranch": "main", + "ref": "ed1e4be2f68bf977f1fa485eba94d89dbef5255c", + "analyzerVersion": "0.3.0", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", + "summary": { + "fileCount": 331, + "directoryCount": 24, + "findingCount": 148, + "repoScore": 588.9999999999997, + "physicalLineCount": 93480, + "logicalLineCount": 30907, + "functionCount": 1250, + "normalized": { + "scorePerFile": 1.7794561933534734, + "scorePerKloc": 19.05717151454362, + "scorePerFunction": 0.47119999999999973, + "findingsPerFile": 0.4471299093655589, + "findingsPerKloc": 4.788559226065293, + "findingsPerFunction": 0.1184 + } + }, + "blended": { + "vsCurrentCohort": 9.15374254041419, + "vsPinnedBaseline": 11.139652858349983 + }, + "ruleCounts": { + "defensive.empty-catch": 85, + "defensive.error-obscuring": 31, + "structure.pass-through-wrappers": 11, + "defensive.error-swallowing": 9, + "defensive.promise-default-fallbacks": 8, + "defensive.stringified-unknown-errors": 2, + "api.generic-status-envelopes": 1, + "types.generic-record-casts": 1 + } + }, + "highest": { + "periodStart": "2026-04-20", + "recordedAt": "2026-04-26T18:00:48.765Z", + "defaultBranch": "main", + "ref": "ed1e4be2f68bf977f1fa485eba94d89dbef5255c", + "blendedVsPinnedBaseline": 11.139652858349983 + }, + "series": [ + { + "periodStart": "2026-03-23", + "recordedAt": "2026-03-23T12:00:00Z", + "blendedVsCurrentCohort": 6.101414127021402, + "blendedVsPinnedBaseline": 6.370934113832667, + "repoScore": 205.10000000000005, + "findingCount": 47 + }, + { + "periodStart": "2026-03-30", + "recordedAt": "2026-03-30T12:00:00Z", + "blendedVsCurrentCohort": 5.11559977530993, + "blendedVsPinnedBaseline": 5.315480989347836, + "repoScore": 320.46666666666664, + "findingCount": 72 + }, + { + "periodStart": "2026-04-06", + "recordedAt": "2026-04-06T12:00:00Z", + "blendedVsCurrentCohort": 5.212918457407813, + "blendedVsPinnedBaseline": 5.415292648343023, + "repoScore": 402.2999999999998, + "findingCount": 88 + }, + { + "periodStart": "2026-04-13", + "recordedAt": "2026-04-13T12:00:00Z", + "blendedVsCurrentCohort": 4.590293228472618, + "blendedVsPinnedBaseline": 4.772332677129107, + "repoScore": 364.1533333333332, + "findingCount": 91 + }, + { + "periodStart": "2026-04-20", + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 9.15374254041419, + "blendedVsPinnedBaseline": 11.139652858349983, + "repoScore": 588.9999999999997, + "findingCount": 148 + } + ], + "deltaFromFirst": { + "blendedVsCurrentCohort": 3.052328413392787, + "blendedVsPinnedBaseline": 4.768718744517316, + "repoScore": 383.89999999999964, + "findingCount": 101, + "fileCount": 253, + "logicalLineCount": 21694, + "functionCount": 959, + "scorePerFile": -0.850030986133707, + "scorePerKloc": -3.2048495426581702, + "scorePerFunction": -0.2336109965635743, + "findingsPerFile": -0.15543419319854362, + "findingsPerKloc": -0.3129278031325802, + "findingsPerFunction": -0.04311202749140894 + }, + "deltaFromPrevious": { + "blendedVsCurrentCohort": 4.5634493119415716, + "blendedVsPinnedBaseline": 6.367320181220876, + "repoScore": 224.84666666666647, + "findingCount": 57, + "fileCount": 145, + "logicalLineCount": 11423, + "functionCount": 375, + "scorePerFile": -0.17835742671821042, + "scorePerKloc": 0.3673063260128657, + "scorePerFunction": 0.0550247619047618, + "findingsPerFile": -0.04211740246239809, + "findingsPerKloc": 0.11806035519688862, + "findingsPerFunction": 0.01440000000000001 + } + }, { "id": "fulling", "repo": "FullAgent/fulling", "cohort": "explicit-ai", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -153,7 +373,7 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "fulling", "repo": "FullAgent/fulling", @@ -162,48 +382,45 @@ "defaultBranch": "main", "ref": "d95060f8421b5888564fc8517c1fe99ded463985", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { "fileCount": 219, "directoryCount": 78, - "findingCount": 74, - "repoScore": 303.59166666666664, + "findingCount": 64, + "repoScore": 279.29999999999995, "physicalLineCount": 26787, "logicalLineCount": 12154, "functionCount": 574, "normalized": { - "scorePerFile": 1.3862633181126331, - "scorePerKloc": 24.978744994789093, - "scorePerFunction": 0.5289053426248548, - "findingsPerFile": 0.3378995433789954, - "findingsPerKloc": 6.088530524930064, - "findingsPerFunction": 0.1289198606271777 + "scorePerFile": 1.2753424657534245, + "scorePerKloc": 22.980088859634684, + "scorePerFunction": 0.48658536585365847, + "findingsPerFile": 0.2922374429223744, + "findingsPerKloc": 5.265756129669245, + "findingsPerFunction": 0.11149825783972125 } }, "blended": { - "vsCurrentCohort": 4.7534391115322565, - "vsPinnedBaseline": 5.012294868481783 + "vsCurrentCohort": 8.416060514231665, + "vsPinnedBaseline": 10.241930243229788 }, "ruleCounts": { "api.generic-status-envelopes": 31, "defensive.error-swallowing": 11, "defensive.stringified-unknown-errors": 6, "defensive.error-obscuring": 5, - "structure.barrel-density": 4, "structure.pass-through-wrappers": 4, - "defensive.async-noise": 3, "defensive.empty-catch": 3, - "structure.directory-fanout-hotspot": 3, "tests.duplicate-mock-setup": 3, "defensive.promise-default-fallbacks": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", "ref": "d95060f8421b5888564fc8517c1fe99ded463985", - "blendedVsPinnedBaseline": 5.012294868481783 + "blendedVsPinnedBaseline": 10.241930243229788 }, "series": [ { @@ -240,92 +457,91 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 4.7534391115322565, - "blendedVsPinnedBaseline": 5.012294868481783, - "repoScore": 303.59166666666664, - "findingCount": 74 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 8.416060514231665, + "blendedVsPinnedBaseline": 10.241930243229788, + "repoScore": 279.29999999999995, + "findingCount": 64 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 2.6848238117222234, - "blendedVsPinnedBaseline": 2.8523018721713216, - "repoScore": 192.49999999999994, - "findingCount": 41, + "blendedVsCurrentCohort": 6.347445214421632, + "blendedVsPinnedBaseline": 8.081937246919328, + "repoScore": 168.20833333333326, + "findingCount": 31, "fileCount": 14, "logicalLineCount": 1403, "functionCount": 3, - "scorePerFile": 0.844352749006942, - "scorePerKloc": 14.645597690662342, - "scorePerFunction": 0.33434900870775025, - "findingsPerFile": 0.17692393362289785, - "findingsPerKloc": 3.0190486162704047, - "findingsPerFunction": 0.07112651561842112 + "scorePerFile": 0.7334318966477333, + "scorePerKloc": 12.646941555507933, + "scorePerFunction": 0.29202903193655394, + "findingsPerFile": 0.13126183316627685, + "findingsPerKloc": 2.196274221009585, + "findingsPerFunction": 0.053704912830964686 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 2.6785253023700384, - "blendedVsPinnedBaseline": 2.855095212418384, - "repoScore": 187.99999999999994, - "findingCount": 38, + "blendedVsCurrentCohort": 6.3411467050694466, + "blendedVsPinnedBaseline": 8.084730587166389, + "repoScore": 163.70833333333326, + "findingCount": 28, "fileCount": 0, "logicalLineCount": 0, "functionCount": 0, - "scorePerFile": 0.8584474885844747, - "scorePerKloc": 15.468158630903401, - "scorePerFunction": 0.3275261324041811, - "findingsPerFile": 0.1735159817351598, - "findingsPerKloc": 3.1265427019911143, - "findingsPerFunction": 0.06620209059233449 + "scorePerFile": 0.747526636225266, + "scorePerKloc": 13.469502495748992, + "scorePerFunction": 0.2852061556329848, + "findingsPerFile": 0.1278538812785388, + "findingsPerKloc": 2.3037683067302948, + "findingsPerFunction": 0.04878048780487805 } }, { - "id": "gstack", - "repo": "garrytan/gstack", + "id": "agent-ci", + "repo": "redwoodjs/agent-ci", "cohort": "explicit-ai", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-03-23T12:00:00Z", "periodStart": "2026-03-23", - "repoId": "gstack", - "repo": "garrytan/gstack", + "repoId": "agent-ci", + "repo": "redwoodjs/agent-ci", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "7fbf68bb3f253ef799f38862fb1cb0b62d756a64", + "ref": "54ef949483c4b8d2157b25d17429abb2c202144c", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 78, - "directoryCount": 10, - "findingCount": 47, - "repoScore": 205.10000000000005, - "physicalLineCount": 30473, - "logicalLineCount": 9213, - "functionCount": 291, + "fileCount": 67, + "directoryCount": 14, + "findingCount": 24, + "repoScore": 76.88571428571429, + "physicalLineCount": 13852, + "logicalLineCount": 6179, + "functionCount": 184, "normalized": { - "scorePerFile": 2.6294871794871804, - "scorePerKloc": 22.26202105720179, - "scorePerFunction": 0.704810996563574, - "findingsPerFile": 0.6025641025641025, - "findingsPerKloc": 5.101487029197873, - "findingsPerFunction": 0.16151202749140894 + "scorePerFile": 1.147547974413646, + "scorePerKloc": 12.443067532887891, + "scorePerFunction": 0.41785714285714287, + "findingsPerFile": 0.3582089552238806, + "findingsPerKloc": 3.8841236446026866, + "findingsPerFunction": 0.13043478260869565 } }, "blended": { - "vsCurrentCohort": 6.101414127021402, - "vsPinnedBaseline": 6.370934113832667 + "vsCurrentCohort": 3.737832240140092, + "vsPinnedBaseline": 3.9029448640486573 }, "ruleCounts": { - "defensive.empty-catch": 30, - "defensive.error-obscuring": 11, + "defensive.empty-catch": 17, "defensive.error-swallowing": 3, - "structure.pass-through-wrappers": 2, - "defensive.async-noise": 1 + "defensive.error-obscuring": 2, + "structure.directory-fanout-hotspot": 2 } }, "previous": { @@ -334,171 +550,167 @@ "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-04-13T12:00:00Z", "periodStart": "2026-04-13", - "repoId": "gstack", - "repo": "garrytan/gstack", + "repoId": "agent-ci", + "repo": "redwoodjs/agent-ci", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "c6e6a21d1a9a58e771403260ff6a134898f2dd02", + "ref": "c61f27d7734c74a9c0b9efa7bb833ff451c8b61c", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 186, - "directoryCount": 19, - "findingCount": 91, - "repoScore": 364.1533333333332, - "physicalLineCount": 64888, - "logicalLineCount": 19484, - "functionCount": 875, + "fileCount": 114, + "directoryCount": 28, + "findingCount": 38, + "repoScore": 140.10000000000005, + "physicalLineCount": 22952, + "logicalLineCount": 11687, + "functionCount": 278, "normalized": { - "scorePerFile": 1.9578136200716838, - "scorePerKloc": 18.689865188530753, - "scorePerFunction": 0.41617523809523793, - "findingsPerFile": 0.489247311827957, - "findingsPerKloc": 4.670498870868404, - "findingsPerFunction": 0.104 + "scorePerFile": 1.228947368421053, + "scorePerKloc": 11.987678617267054, + "scorePerFunction": 0.5039568345323743, + "findingsPerFile": 0.3333333333333333, + "findingsPerKloc": 3.2514759989732185, + "findingsPerFunction": 0.1366906474820144 } }, "blended": { - "vsCurrentCohort": 4.590293228472618, - "vsPinnedBaseline": 4.772332677129107 + "vsCurrentCohort": 3.763892950592061, + "vsPinnedBaseline": 3.913159449141177 }, "ruleCounts": { - "defensive.empty-catch": 52, - "defensive.error-obscuring": 19, - "structure.pass-through-wrappers": 9, - "defensive.error-swallowing": 8, - "structure.directory-fanout-hotspot": 2, - "defensive.async-noise": 1 + "defensive.empty-catch": 22, + "tests.duplicate-mock-setup": 6, + "defensive.error-obscuring": 5, + "defensive.error-swallowing": 3, + "structure.barrel-density": 1, + "structure.pass-through-wrappers": 1 } }, "latest": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", - "repoId": "gstack", - "repo": "garrytan/gstack", + "repoId": "agent-ci", + "repo": "redwoodjs/agent-ci", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "d0782c4c4da2e71e3bc714317d5da5b3ce1072ad", + "ref": "76b46f9929509a90355f34c0550dc20d29924aec", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 273, - "directoryCount": 24, - "findingCount": 124, - "repoScore": 508.0666666666663, - "physicalLineCount": 79937, - "logicalLineCount": 25744, - "functionCount": 1091, + "fileCount": 156, + "directoryCount": 42, + "findingCount": 60, + "repoScore": 207.50000000000003, + "physicalLineCount": 30109, + "logicalLineCount": 14645, + "functionCount": 483, "normalized": { - "scorePerFile": 1.8610500610500598, - "scorePerKloc": 19.73534286306193, - "scorePerFunction": 0.4656889703635805, - "findingsPerFile": 0.4542124542124542, - "findingsPerKloc": 4.816656308266004, - "findingsPerFunction": 0.11365719523373052 + "scorePerFile": 1.3301282051282053, + "scorePerKloc": 14.16865824513486, + "scorePerFunction": 0.4296066252587992, + "findingsPerFile": 0.38461538461538464, + "findingsPerKloc": 4.09696142027996, + "findingsPerFunction": 0.12422360248447205 } }, "blended": { - "vsCurrentCohort": 4.64931478116071, - "vsPinnedBaseline": 4.902500289323458 + "vsCurrentCohort": 7.828395917596652, + "vsPinnedBaseline": 9.52677143526095 }, "ruleCounts": { - "defensive.empty-catch": 66, - "defensive.error-obscuring": 24, - "structure.pass-through-wrappers": 11, - "defensive.error-swallowing": 8, - "defensive.promise-default-fallbacks": 7, - "structure.directory-fanout-hotspot": 2, - "types.generic-record-casts": 2, - "api.generic-status-envelopes": 1, - "comments.placeholder-comments": 1, - "defensive.async-noise": 1, - "defensive.stringified-unknown-errors": 1 + "defensive.empty-catch": 25, + "defensive.error-obscuring": 11, + "defensive.promise-default-fallbacks": 9, + "defensive.error-swallowing": 6, + "tests.duplicate-mock-setup": 6, + "structure.pass-through-wrappers": 2, + "api.generic-status-envelopes": 1 } }, "highest": { - "periodStart": "2026-03-23", - "recordedAt": "2026-03-23T12:00:00Z", + "periodStart": "2026-04-20", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "7fbf68bb3f253ef799f38862fb1cb0b62d756a64", - "blendedVsPinnedBaseline": 6.370934113832667 + "ref": "76b46f9929509a90355f34c0550dc20d29924aec", + "blendedVsPinnedBaseline": 9.52677143526095 }, "series": [ { "periodStart": "2026-03-23", "recordedAt": "2026-03-23T12:00:00Z", - "blendedVsCurrentCohort": 6.101414127021402, - "blendedVsPinnedBaseline": 6.370934113832667, - "repoScore": 205.10000000000005, - "findingCount": 47 + "blendedVsCurrentCohort": 3.737832240140092, + "blendedVsPinnedBaseline": 3.9029448640486573, + "repoScore": 76.88571428571429, + "findingCount": 24 }, { "periodStart": "2026-03-30", "recordedAt": "2026-03-30T12:00:00Z", - "blendedVsCurrentCohort": 5.11559977530993, - "blendedVsPinnedBaseline": 5.315480989347836, - "repoScore": 320.46666666666664, - "findingCount": 72 + "blendedVsCurrentCohort": 3.304551337754753, + "blendedVsPinnedBaseline": 3.4336696742651553, + "repoScore": 79.35714285714288, + "findingCount": 25 }, { "periodStart": "2026-04-06", "recordedAt": "2026-04-06T12:00:00Z", - "blendedVsCurrentCohort": 5.212918457407813, - "blendedVsPinnedBaseline": 5.415292648343023, - "repoScore": 402.2999999999998, - "findingCount": 88 + "blendedVsCurrentCohort": 3.277166214819975, + "blendedVsPinnedBaseline": 3.4043912743913416, + "repoScore": 81.35714285714288, + "findingCount": 26 }, { "periodStart": "2026-04-13", "recordedAt": "2026-04-13T12:00:00Z", - "blendedVsCurrentCohort": 4.590293228472618, - "blendedVsPinnedBaseline": 4.772332677129107, - "repoScore": 364.1533333333332, - "findingCount": 91 + "blendedVsCurrentCohort": 3.763892950592061, + "blendedVsPinnedBaseline": 3.913159449141177, + "repoScore": 140.10000000000005, + "findingCount": 38 }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 4.64931478116071, - "blendedVsPinnedBaseline": 4.902500289323458, - "repoScore": 508.0666666666663, - "findingCount": 124 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 7.828395917596652, + "blendedVsPinnedBaseline": 9.52677143526095, + "repoScore": 207.50000000000003, + "findingCount": 60 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": -1.4520993458606926, - "blendedVsPinnedBaseline": -1.4684338245092086, - "repoScore": 302.96666666666624, - "findingCount": 77, - "fileCount": 195, - "logicalLineCount": 16531, - "functionCount": 800, - "scorePerFile": -0.7684371184371206, - "scorePerKloc": -2.5266781941398584, - "scorePerFunction": -0.23912202619999356, - "findingsPerFile": -0.14835164835164832, - "findingsPerKloc": -0.28483072093186923, - "findingsPerFunction": -0.04785483225767842 + "blendedVsCurrentCohort": 4.090563677456561, + "blendedVsPinnedBaseline": 5.623826571212292, + "repoScore": 130.61428571428576, + "findingCount": 36, + "fileCount": 89, + "logicalLineCount": 8466, + "functionCount": 299, + "scorePerFile": 0.1825802307145592, + "scorePerKloc": 1.7255907122469694, + "scorePerFunction": 0.011749482401656353, + "findingsPerFile": 0.02640642939150406, + "findingsPerKloc": 0.21283777567727302, + "findingsPerFunction": -0.0062111801242236 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.05902155268809217, - "blendedVsPinnedBaseline": 0.13016761219435136, - "repoScore": 143.91333333333313, - "findingCount": 33, - "fileCount": 87, - "logicalLineCount": 6260, - "functionCount": 216, - "scorePerFile": -0.09676355902162403, - "scorePerKloc": 1.0454776745311776, - "scorePerFunction": 0.04951373226834255, - "findingsPerFile": -0.03503485761550279, - "findingsPerKloc": 0.14615743739759957, - "findingsPerFunction": 0.009657195233730528 + "blendedVsCurrentCohort": 4.064502967004591, + "blendedVsPinnedBaseline": 5.613611986119772, + "repoScore": 67.39999999999998, + "findingCount": 22, + "fileCount": 42, + "logicalLineCount": 2958, + "functionCount": 205, + "scorePerFile": 0.10118083670715228, + "scorePerKloc": 2.1809796278678064, + "scorePerFunction": -0.07435020927357505, + "findingsPerFile": 0.05128205128205132, + "findingsPerKloc": 0.8454854213067411, + "findingsPerFunction": -0.01246704499754235 } }, { @@ -507,7 +719,7 @@ "cohort": "explicit-ai", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -598,7 +810,7 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "devworkbench", "repo": "jiayun/DevWorkbench", @@ -607,44 +819,42 @@ "defaultBranch": "main", "ref": "ea50862107c377b0cdd6e508073ad0330b367576", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { "fileCount": 32, "directoryCount": 7, - "findingCount": 17, - "repoScore": 48.13333333333334, + "findingCount": 15, + "repoScore": 40.300000000000004, "physicalLineCount": 9408, "logicalLineCount": 2986, "functionCount": 147, "normalized": { - "scorePerFile": 1.5041666666666669, - "scorePerKloc": 16.119669569100246, - "scorePerFunction": 0.32743764172335604, - "findingsPerFile": 0.53125, - "findingsPerKloc": 5.693235097119892, - "findingsPerFunction": 0.11564625850340136 + "scorePerFile": 1.2593750000000001, + "scorePerKloc": 13.496316141995981, + "scorePerFunction": 0.2741496598639456, + "findingsPerFile": 0.46875, + "findingsPerKloc": 5.023442732752846, + "findingsPerFunction": 0.10204081632653061 } }, "blended": { - "vsCurrentCohort": 4.330459252026686, - "vsPinnedBaseline": 4.56628099736111 + "vsCurrentCohort": 7.3878985235742185, + "vsPinnedBaseline": 8.990707848946045 }, "ruleCounts": { "defensive.error-swallowing": 10, "defensive.stringified-unknown-errors": 2, "defensive.empty-catch": 1, "defensive.promise-default-fallbacks": 1, - "structure.barrel-density": 1, - "structure.directory-fanout-hotspot": 1, "structure.pass-through-wrappers": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", "ref": "ea50862107c377b0cdd6e508073ad0330b367576", - "blendedVsPinnedBaseline": 4.56628099736111 + "blendedVsPinnedBaseline": 8.990707848946045 }, "series": [ { @@ -681,88 +891,91 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 4.330459252026686, - "blendedVsPinnedBaseline": 4.56628099736111, - "repoScore": 48.13333333333334, - "findingCount": 17 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 7.3878985235742185, + "blendedVsPinnedBaseline": 8.990707848946045, + "repoScore": 40.300000000000004, + "findingCount": 15 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 1.0699496292322808, - "blendedVsPinnedBaseline": 1.161743696353268, - "repoScore": 16.000000000000007, - "findingCount": 3, + "blendedVsCurrentCohort": 4.127388900779813, + "blendedVsPinnedBaseline": 5.5861705479382024, + "repoScore": 8.166666666666671, + "findingCount": 1, "fileCount": 0, "logicalLineCount": 29, "functionCount": 1, - "scorePerFile": 0.5000000000000002, - "scorePerKloc": 5.252799994080519, - "scorePerFunction": 0.10734631752244281, - "findingsPerFile": 0.09375, - "findingsPerKloc": 0.9587068590407579, - "findingsPerFunction": 0.01975584754449726 + "scorePerFile": 0.2552083333333335, + "scorePerKloc": 2.629446566976254, + "scorePerFunction": 0.05405833566303239, + "findingsPerFile": 0.03125, + "findingsPerKloc": 0.2889144946737119, + "findingsPerFunction": 0.00615040536762651 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 1.073841172961978, - "blendedVsPinnedBaseline": 1.1805136613555867, - "repoScore": 16.000000000000007, - "findingCount": 3, + "blendedVsCurrentCohort": 4.13128044450951, + "blendedVsPinnedBaseline": 5.604940512940521, + "repoScore": 8.166666666666671, + "findingCount": 1, "fileCount": 0, "logicalLineCount": 0, "functionCount": 0, - "scorePerFile": 0.5000000000000002, - "scorePerKloc": 5.358338914936372, - "scorePerFunction": 0.10884353741496602, - "findingsPerFile": 0.09375, - "findingsPerKloc": 1.004688546550569, - "findingsPerFunction": 0.02040816326530613 + "scorePerFile": 0.2552083333333335, + "scorePerKloc": 2.734985487832107, + "scorePerFunction": 0.05555555555555561, + "findingsPerFile": 0.03125, + "findingsPerKloc": 0.334896182183523, + "findingsPerFunction": 0.006802721088435382 } }, { - "id": "agent-ci", - "repo": "redwoodjs/agent-ci", + "id": "openusage", + "repo": "robinebers/openusage", "cohort": "explicit-ai", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-03-23T12:00:00Z", "periodStart": "2026-03-23", - "repoId": "agent-ci", - "repo": "redwoodjs/agent-ci", + "repoId": "openusage", + "repo": "robinebers/openusage", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "54ef949483c4b8d2157b25d17429abb2c202144c", + "ref": "fa06dbff4fce4f29b788f1c45224e43982d6098e", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 67, - "directoryCount": 14, - "findingCount": 24, - "repoScore": 76.88571428571429, - "physicalLineCount": 13852, - "logicalLineCount": 6179, - "functionCount": 184, + "fileCount": 137, + "directoryCount": 29, + "findingCount": 46, + "repoScore": 176.2, + "physicalLineCount": 33319, + "logicalLineCount": 21875, + "functionCount": 485, "normalized": { - "scorePerFile": 1.147547974413646, - "scorePerKloc": 12.443067532887891, - "scorePerFunction": 0.41785714285714287, - "findingsPerFile": 0.3582089552238806, - "findingsPerKloc": 3.8841236446026866, - "findingsPerFunction": 0.13043478260869565 + "scorePerFile": 1.2861313868613138, + "scorePerKloc": 8.054857142857143, + "scorePerFunction": 0.3632989690721649, + "findingsPerFile": 0.3357664233576642, + "findingsPerKloc": 2.1028571428571428, + "findingsPerFunction": 0.09484536082474226 } }, "blended": { - "vsCurrentCohort": 3.737832240140092, - "vsPinnedBaseline": 3.9029448640486573 + "vsCurrentCohort": 2.931613483257123, + "vsPinnedBaseline": 3.0611127125987165 }, "ruleCounts": { - "defensive.empty-catch": 17, + "tests.duplicate-mock-setup": 25, + "structure.duplicate-function-signatures": 5, + "structure.pass-through-wrappers": 5, + "defensive.empty-catch": 4, "defensive.error-swallowing": 3, "defensive.error-obscuring": 2, "structure.directory-fanout-hotspot": 2 @@ -774,169 +987,168 @@ "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-04-13T12:00:00Z", "periodStart": "2026-04-13", - "repoId": "agent-ci", - "repo": "redwoodjs/agent-ci", + "repoId": "openusage", + "repo": "robinebers/openusage", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "c61f27d7734c74a9c0b9efa7bb833ff451c8b61c", + "ref": "06113d6b94c6f8306e67aedf51b42f3f03d8b3e5", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 114, - "directoryCount": 28, - "findingCount": 38, - "repoScore": 140.10000000000005, - "physicalLineCount": 22952, - "logicalLineCount": 11687, - "functionCount": 278, + "fileCount": 143, + "directoryCount": 31, + "findingCount": 50, + "repoScore": 195.3111111111111, + "physicalLineCount": 36980, + "logicalLineCount": 24758, + "functionCount": 562, "normalized": { - "scorePerFile": 1.228947368421053, - "scorePerKloc": 11.987678617267054, - "scorePerFunction": 0.5039568345323743, - "findingsPerFile": 0.3333333333333333, - "findingsPerKloc": 3.2514759989732185, - "findingsPerFunction": 0.1366906474820144 + "scorePerFile": 1.3658119658119658, + "scorePerKloc": 7.8888081069194245, + "scorePerFunction": 0.34752866745749306, + "findingsPerFile": 0.34965034965034963, + "findingsPerKloc": 2.0195492366103887, + "findingsPerFunction": 0.08896797153024912 } }, "blended": { - "vsCurrentCohort": 3.763892950592061, - "vsPinnedBaseline": 3.913159449141177 + "vsCurrentCohort": 2.9106934453164324, + "vsPinnedBaseline": 3.0261242040110723 }, "ruleCounts": { - "defensive.empty-catch": 22, - "tests.duplicate-mock-setup": 6, - "defensive.error-obscuring": 5, + "tests.duplicate-mock-setup": 28, + "structure.duplicate-function-signatures": 5, + "structure.pass-through-wrappers": 5, + "defensive.empty-catch": 4, + "defensive.error-obscuring": 3, "defensive.error-swallowing": 3, - "structure.barrel-density": 1, - "structure.pass-through-wrappers": 1 + "structure.directory-fanout-hotspot": 2 } }, "latest": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", - "repoId": "agent-ci", - "repo": "redwoodjs/agent-ci", + "repoId": "openusage", + "repo": "robinebers/openusage", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "37f98a6c372bf909aeb5b8c7b1194708febccdce", + "ref": "584d44d3910e16780ef2c206399ad0de5d596404", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 137, - "directoryCount": 33, - "findingCount": 57, - "repoScore": 202.50000000000003, - "physicalLineCount": 28299, - "logicalLineCount": 13697, - "functionCount": 399, + "fileCount": 143, + "directoryCount": 31, + "findingCount": 45, + "repoScore": 188.7, + "physicalLineCount": 37446, + "logicalLineCount": 25153, + "functionCount": 566, "normalized": { - "scorePerFile": 1.478102189781022, - "scorePerKloc": 14.7842593268599, - "scorePerFunction": 0.5075187969924813, - "findingsPerFile": 0.41605839416058393, - "findingsPerKloc": 4.161495217930934, - "findingsPerFunction": 0.14285714285714285 + "scorePerFile": 1.3195804195804195, + "scorePerKloc": 7.502087226175804, + "scorePerFunction": 0.33339222614840985, + "findingsPerFile": 0.3146853146853147, + "findingsPerKloc": 1.7890510078320678, + "findingsPerFunction": 0.07950530035335689 } }, "blended": { - "vsCurrentCohort": 4.321646110996529, - "vsPinnedBaseline": 4.556987923331088 + "vsCurrentCohort": 5.271326639649764, + "vsPinnedBaseline": 6.4149443366378405 }, "ruleCounts": { - "defensive.empty-catch": 23, - "defensive.error-obscuring": 9, - "defensive.promise-default-fallbacks": 8, - "defensive.error-swallowing": 6, - "tests.duplicate-mock-setup": 6, - "structure.pass-through-wrappers": 2, + "tests.duplicate-mock-setup": 28, + "structure.pass-through-wrappers": 5, + "defensive.empty-catch": 4, + "defensive.error-obscuring": 3, + "defensive.error-swallowing": 3, "api.generic-status-envelopes": 1, - "structure.barrel-density": 1, - "structure.directory-fanout-hotspot": 1 + "defensive.promise-default-fallbacks": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "37f98a6c372bf909aeb5b8c7b1194708febccdce", - "blendedVsPinnedBaseline": 4.556987923331088 + "ref": "584d44d3910e16780ef2c206399ad0de5d596404", + "blendedVsPinnedBaseline": 6.4149443366378405 }, "series": [ { "periodStart": "2026-03-23", "recordedAt": "2026-03-23T12:00:00Z", - "blendedVsCurrentCohort": 3.737832240140092, - "blendedVsPinnedBaseline": 3.9029448640486573, - "repoScore": 76.88571428571429, - "findingCount": 24 + "blendedVsCurrentCohort": 2.931613483257123, + "blendedVsPinnedBaseline": 3.0611127125987165, + "repoScore": 176.2, + "findingCount": 46 }, { "periodStart": "2026-03-30", "recordedAt": "2026-03-30T12:00:00Z", - "blendedVsCurrentCohort": 3.304551337754753, - "blendedVsPinnedBaseline": 3.4336696742651553, - "repoScore": 79.35714285714288, - "findingCount": 25 + "blendedVsCurrentCohort": 2.9124251564230508, + "blendedVsPinnedBaseline": 3.0262219938672197, + "repoScore": 176.3111111111111, + "findingCount": 46 }, { "periodStart": "2026-04-06", "recordedAt": "2026-04-06T12:00:00Z", - "blendedVsCurrentCohort": 3.277166214819975, - "blendedVsPinnedBaseline": 3.4043912743913416, - "repoScore": 81.35714285714288, - "findingCount": 26 + "blendedVsCurrentCohort": 2.9040660942565824, + "blendedVsPinnedBaseline": 3.016806784725735, + "repoScore": 176.3111111111111, + "findingCount": 46 }, { "periodStart": "2026-04-13", "recordedAt": "2026-04-13T12:00:00Z", - "blendedVsCurrentCohort": 3.763892950592061, - "blendedVsPinnedBaseline": 3.913159449141177, - "repoScore": 140.10000000000005, - "findingCount": 38 + "blendedVsCurrentCohort": 2.9106934453164324, + "blendedVsPinnedBaseline": 3.0261242040110723, + "repoScore": 195.3111111111111, + "findingCount": 50 }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 4.321646110996529, - "blendedVsPinnedBaseline": 4.556987923331088, - "repoScore": 202.50000000000003, - "findingCount": 57 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 5.271326639649764, + "blendedVsPinnedBaseline": 6.4149443366378405, + "repoScore": 188.7, + "findingCount": 45 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 0.5838138708564369, - "blendedVsPinnedBaseline": 0.6540430592824311, - "repoScore": 125.61428571428574, - "findingCount": 33, - "fileCount": 70, - "logicalLineCount": 7518, - "functionCount": 215, - "scorePerFile": 0.33055421536737595, - "scorePerKloc": 2.3411917939720084, - "scorePerFunction": 0.08966165413533839, - "findingsPerFile": 0.05784943893670336, - "findingsPerKloc": 0.2773715733282476, - "findingsPerFunction": 0.0124223602484472 + "blendedVsCurrentCohort": 2.3397131563926408, + "blendedVsPinnedBaseline": 3.353831624039124, + "repoScore": 12.5, + "findingCount": -1, + "fileCount": 6, + "logicalLineCount": 3278, + "functionCount": 81, + "scorePerFile": 0.03344903271910571, + "scorePerKloc": -0.5527699166813393, + "scorePerFunction": -0.02990674292375506, + "findingsPerFile": -0.021081108672349524, + "findingsPerKloc": -0.31380613502507493, + "findingsPerFunction": -0.015340060471385378 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.5577531604044679, - "blendedVsPinnedBaseline": 0.6438284741899114, - "repoScore": 62.39999999999998, - "findingCount": 19, - "fileCount": 23, - "logicalLineCount": 2010, - "functionCount": 121, - "scorePerFile": 0.24915482135996903, - "scorePerKloc": 2.7965807095928454, - "scorePerFunction": 0.003561962460106982, - "findingsPerFile": 0.08272506082725062, - "findingsPerKloc": 0.9100192189577156, - "findingsPerFunction": 0.00616649537512845 + "blendedVsCurrentCohort": 2.360633194333331, + "blendedVsPinnedBaseline": 3.388820132626768, + "repoScore": -6.611111111111114, + "findingCount": -5, + "fileCount": 0, + "logicalLineCount": 395, + "functionCount": 4, + "scorePerFile": -0.04623154623154635, + "scorePerKloc": -0.38672088074362065, + "scorePerFunction": -0.014136441309083203, + "findingsPerFile": -0.03496503496503495, + "findingsPerKloc": -0.23049822877832082, + "findingsPerFunction": -0.009462671176892229 } }, { @@ -945,7 +1157,7 @@ "cohort": "explicit-ai", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -1046,60 +1258,55 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "openclaw", "repo": "openclaw/openclaw", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "d2b67fbb681a4219c5ed3d9653b9180caaf874f8", + "ref": "6b6dcafcee9ca86385b7c1ee2442752314d50257", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 11826, - "directoryCount": 448, - "findingCount": 4539, - "repoScore": 15223.222299974419, - "physicalLineCount": 2247802, - "logicalLineCount": 1170720, - "functionCount": 46760, + "fileCount": 13468, + "directoryCount": 500, + "findingCount": 3788, + "repoScore": 13474.59999999997, + "physicalLineCount": 2587247, + "logicalLineCount": 1327902, + "functionCount": 53442, "normalized": { - "scorePerFile": 1.287267233212787, - "scorePerKloc": 13.003299080885625, - "scorePerFunction": 0.32556078485830664, - "findingsPerFile": 0.38381532217148656, - "findingsPerKloc": 3.87710127101271, - "findingsPerFunction": 0.09707014542343884 + "scorePerFile": 1.0004900504900482, + "scorePerKloc": 10.14728496530615, + "scorePerFunction": 0.25213502488679257, + "findingsPerFile": 0.28125928125928124, + "findingsPerKloc": 2.852620148173585, + "findingsPerFunction": 0.0708805808165862 } }, "blended": { - "vsCurrentCohort": 3.5098116648847677, - "vsPinnedBaseline": 3.700943797630476 + "vsCurrentCohort": 5.258406087506312, + "vsPinnedBaseline": 6.399220662415981 }, "ruleCounts": { - "tests.duplicate-mock-setup": 1001, - "structure.pass-through-wrappers": 695, - "structure.barrel-density": 433, - "defensive.error-obscuring": 424, - "defensive.promise-default-fallbacks": 374, - "api.generic-status-envelopes": 365, - "defensive.async-noise": 342, - "defensive.empty-catch": 342, - "structure.duplicate-function-signatures": 253, - "types.generic-record-casts": 131, - "structure.directory-fanout-hotspot": 78, - "defensive.stringified-unknown-errors": 62, - "structure.over-fragmentation": 24, - "defensive.error-swallowing": 15 + "tests.duplicate-mock-setup": 1054, + "structure.pass-through-wrappers": 805, + "defensive.error-obscuring": 492, + "defensive.promise-default-fallbacks": 404, + "api.generic-status-envelopes": 399, + "defensive.empty-catch": 358, + "types.generic-record-casts": 151, + "defensive.stringified-unknown-errors": 107, + "defensive.error-swallowing": 18 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "d2b67fbb681a4219c5ed3d9653b9180caaf874f8", - "blendedVsPinnedBaseline": 3.700943797630476 + "ref": "6b6dcafcee9ca86385b7c1ee2442752314d50257", + "blendedVsPinnedBaseline": 6.399220662415981 }, "series": [ { @@ -1136,297 +1343,73 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 3.5098116648847677, - "blendedVsPinnedBaseline": 3.700943797630476, - "repoScore": 15223.222299974419, - "findingCount": 4539 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 5.258406087506312, + "blendedVsPinnedBaseline": 6.399220662415981, + "repoScore": 13474.59999999997, + "findingCount": 3788 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 0.7027429185225174, - "blendedVsPinnedBaseline": 0.7698773819169054, - "repoScore": 7500.620411011581, - "findingCount": 2198, - "fileCount": 4136, - "logicalLineCount": 410965, - "functionCount": 16908, - "scorePerFile": 0.28302771579239194, - "scorePerKloc": 2.83870406148748, - "scorePerFunction": 0.06686448682256907, - "findingsPerFile": 0.0793939957735672, - "findingsPerKloc": 0.7958448133388547, - "findingsPerFunction": 0.01864993907210559 + "blendedVsCurrentCohort": 2.451337341144062, + "blendedVsPinnedBaseline": 3.4681542467024107, + "repoScore": 5751.998111037132, + "findingCount": 1447, + "fileCount": 5778, + "logicalLineCount": 568147, + "functionCount": 23590, + "scorePerFile": -0.003749466930346834, + "scorePerKloc": -0.017310054091995042, + "scorePerFunction": -0.006561273148945002, + "findingsPerFile": -0.02316204513863812, + "findingsPerKloc": -0.22863630950027058, + "findingsPerFunction": -0.0075396255347470464 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.6987175398981922, - "blendedVsPinnedBaseline": 0.7783687717158507, - "repoScore": 3967.2252171215987, - "findingCount": 1051, - "fileCount": 459, - "logicalLineCount": 50986, - "functionCount": 2523, - "scorePerFile": 0.29703259937335535, - "scorePerKloc": 2.950914244082581, - "scorePerFunction": 0.07111321646865948, - "findingsPerFile": 0.0769621507102391, - "findingsPerKloc": 0.7620757381629439, - "findingsPerFunction": 0.01822212227539534 + "blendedVsCurrentCohort": 2.447311962519737, + "blendedVsPinnedBaseline": 3.476645636501356, + "repoScore": 2218.602917147149, + "findingCount": 300, + "fileCount": 2101, + "logicalLineCount": 208168, + "functionCount": 9205, + "scorePerFile": 0.010255416650616578, + "scorePerKloc": 0.09490012850310592, + "scorePerFunction": -0.0023125435028545915, + "findingsPerFile": -0.02559389020196623, + "findingsPerKloc": -0.26240538467618135, + "findingsPerFunction": -0.007967442331457297 } }, { - "id": "openusage", - "repo": "robinebers/openusage", + "id": "emdash", + "repo": "emdash-cms/emdash", "cohort": "explicit-ai", - "pointCount": 5, - "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "pointCount": 3, + "firstRecordedAt": "2026-04-06T12:00:00Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-03-23T12:00:00Z", - "periodStart": "2026-03-23", - "repoId": "openusage", - "repo": "robinebers/openusage", + "recordedAt": "2026-04-06T12:00:00Z", + "periodStart": "2026-04-06", + "repoId": "emdash", + "repo": "emdash-cms/emdash", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "fa06dbff4fce4f29b788f1c45224e43982d6098e", + "ref": "5f448d1035073283fd7435d2f320d1f3c94898a0", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 137, - "directoryCount": 29, - "findingCount": 46, - "repoScore": 176.2, - "physicalLineCount": 33319, - "logicalLineCount": 21875, - "functionCount": 485, - "normalized": { - "scorePerFile": 1.2861313868613138, - "scorePerKloc": 8.054857142857143, - "scorePerFunction": 0.3632989690721649, - "findingsPerFile": 0.3357664233576642, - "findingsPerKloc": 2.1028571428571428, - "findingsPerFunction": 0.09484536082474226 - } - }, - "blended": { - "vsCurrentCohort": 2.931613483257123, - "vsPinnedBaseline": 3.0611127125987165 - }, - "ruleCounts": { - "tests.duplicate-mock-setup": 25, - "structure.duplicate-function-signatures": 5, - "structure.pass-through-wrappers": 5, - "defensive.empty-catch": 4, - "defensive.error-swallowing": 3, - "defensive.error-obscuring": 2, - "structure.directory-fanout-hotspot": 2 - } - }, - "previous": { - "schemaVersion": 1, - "benchmarkSetId": "known-ai-vs-solid-oss", - "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-13T12:00:00Z", - "periodStart": "2026-04-13", - "repoId": "openusage", - "repo": "robinebers/openusage", - "cohort": "explicit-ai", - "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "main", - "ref": "06113d6b94c6f8306e67aedf51b42f3f03d8b3e5", - "analyzerVersion": "0.3.0", - "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", - "summary": { - "fileCount": 143, - "directoryCount": 31, - "findingCount": 50, - "repoScore": 195.3111111111111, - "physicalLineCount": 36980, - "logicalLineCount": 24758, - "functionCount": 562, - "normalized": { - "scorePerFile": 1.3658119658119658, - "scorePerKloc": 7.8888081069194245, - "scorePerFunction": 0.34752866745749306, - "findingsPerFile": 0.34965034965034963, - "findingsPerKloc": 2.0195492366103887, - "findingsPerFunction": 0.08896797153024912 - } - }, - "blended": { - "vsCurrentCohort": 2.9106934453164324, - "vsPinnedBaseline": 3.0261242040110723 - }, - "ruleCounts": { - "tests.duplicate-mock-setup": 28, - "structure.duplicate-function-signatures": 5, - "structure.pass-through-wrappers": 5, - "defensive.empty-catch": 4, - "defensive.error-obscuring": 3, - "defensive.error-swallowing": 3, - "structure.directory-fanout-hotspot": 2 - } - }, - "latest": { - "schemaVersion": 1, - "benchmarkSetId": "known-ai-vs-solid-oss", - "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", - "periodStart": "2026-04-20", - "repoId": "openusage", - "repo": "robinebers/openusage", - "cohort": "explicit-ai", - "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "main", - "ref": "584d44d3910e16780ef2c206399ad0de5d596404", - "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", - "summary": { - "fileCount": 143, - "directoryCount": 31, - "findingCount": 52, - "repoScore": 207.3111111111111, - "physicalLineCount": 37446, - "logicalLineCount": 25153, - "functionCount": 566, - "normalized": { - "scorePerFile": 1.4497280497280496, - "scorePerKloc": 8.24200338373598, - "scorePerFunction": 0.3662740478994896, - "findingsPerFile": 0.36363636363636365, - "findingsPerKloc": 2.067347831272612, - "findingsPerFunction": 0.09187279151943463 - } - }, - "blended": { - "vsCurrentCohort": 2.9922952299177115, - "vsPinnedBaseline": 3.155245218038443 - }, - "ruleCounts": { - "tests.duplicate-mock-setup": 28, - "structure.duplicate-function-signatures": 5, - "structure.pass-through-wrappers": 5, - "defensive.empty-catch": 4, - "defensive.error-obscuring": 3, - "defensive.error-swallowing": 3, - "structure.directory-fanout-hotspot": 2, - "api.generic-status-envelopes": 1, - "defensive.promise-default-fallbacks": 1 - } - }, - "highest": { - "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "defaultBranch": "main", - "ref": "584d44d3910e16780ef2c206399ad0de5d596404", - "blendedVsPinnedBaseline": 3.155245218038443 - }, - "series": [ - { - "periodStart": "2026-03-23", - "recordedAt": "2026-03-23T12:00:00Z", - "blendedVsCurrentCohort": 2.931613483257123, - "blendedVsPinnedBaseline": 3.0611127125987165, - "repoScore": 176.2, - "findingCount": 46 - }, - { - "periodStart": "2026-03-30", - "recordedAt": "2026-03-30T12:00:00Z", - "blendedVsCurrentCohort": 2.9124251564230508, - "blendedVsPinnedBaseline": 3.0262219938672197, - "repoScore": 176.3111111111111, - "findingCount": 46 - }, - { - "periodStart": "2026-04-06", - "recordedAt": "2026-04-06T12:00:00Z", - "blendedVsCurrentCohort": 2.9040660942565824, - "blendedVsPinnedBaseline": 3.016806784725735, - "repoScore": 176.3111111111111, - "findingCount": 46 - }, - { - "periodStart": "2026-04-13", - "recordedAt": "2026-04-13T12:00:00Z", - "blendedVsCurrentCohort": 2.9106934453164324, - "blendedVsPinnedBaseline": 3.0261242040110723, - "repoScore": 195.3111111111111, - "findingCount": 50 - }, - { - "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 2.9922952299177115, - "blendedVsPinnedBaseline": 3.155245218038443, - "repoScore": 207.3111111111111, - "findingCount": 52 - } - ], - "deltaFromFirst": { - "blendedVsCurrentCohort": 0.060681746660588676, - "blendedVsPinnedBaseline": 0.09413250543972662, - "repoScore": 31.111111111111114, - "findingCount": 6, - "fileCount": 6, - "logicalLineCount": 3278, - "functionCount": 81, - "scorePerFile": 0.1635966628667358, - "scorePerKloc": 0.18714624087883713, - "scorePerFunction": 0.002975078827324673, - "findingsPerFile": 0.027869940278699434, - "findingsPerKloc": -0.035509311584530856, - "findingsPerFunction": -0.0029725693053076346 - }, - "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.08160178460127909, - "blendedVsPinnedBaseline": 0.12912101402737086, - "repoScore": 12, - "findingCount": 2, - "fileCount": 0, - "logicalLineCount": 395, - "functionCount": 4, - "scorePerFile": 0.08391608391608374, - "scorePerKloc": 0.3531952768165558, - "scorePerFunction": 0.01874538044199653, - "findingsPerFile": 0.013986013986014012, - "findingsPerKloc": 0.04779859466222325, - "findingsPerFunction": 0.002904819989185514 - } - }, - { - "id": "emdash", - "repo": "emdash-cms/emdash", - "cohort": "explicit-ai", - "pointCount": 3, - "firstRecordedAt": "2026-04-06T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", - "first": { - "schemaVersion": 1, - "benchmarkSetId": "known-ai-vs-solid-oss", - "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-06T12:00:00Z", - "periodStart": "2026-04-06", - "repoId": "emdash", - "repo": "emdash-cms/emdash", - "cohort": "explicit-ai", - "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "main", - "ref": "5f448d1035073283fd7435d2f320d1f3c94898a0", - "analyzerVersion": "0.3.0", - "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", - "summary": { - "fileCount": 1072, - "directoryCount": 306, - "findingCount": 239, - "repoScore": 787.2525793650789, - "physicalLineCount": 257919, - "logicalLineCount": 120412, - "functionCount": 3513, + "fileCount": 1072, + "directoryCount": 306, + "findingCount": 239, + "repoScore": 787.2525793650789, + "physicalLineCount": 257919, + "logicalLineCount": 120412, + "functionCount": 3513, "normalized": { "scorePerFile": 0.7343774061241407, "scorePerKloc": 6.537991058740648, @@ -1503,59 +1486,55 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "emdash", "repo": "emdash-cms/emdash", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "f7f4814182e1ad249a9ea15951a1fb5ca4362411", + "ref": "3dd1a1f70ec55afe851138ea15ae01eb805d8673", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 1192, - "directoryCount": 337, - "findingCount": 371, - "repoScore": 1360.345634920635, - "physicalLineCount": 326832, - "logicalLineCount": 155506, - "functionCount": 3817, + "fileCount": 1218, + "directoryCount": 340, + "findingCount": 266, + "repoScore": 1027.2999999999997, + "physicalLineCount": 333193, + "logicalLineCount": 158986, + "functionCount": 3919, "normalized": { - "scorePerFile": 1.1412295594971769, - "scorePerKloc": 8.74786590176993, - "scorePerFunction": 0.35639131121840056, - "findingsPerFile": 0.311241610738255, - "findingsPerKloc": 2.385760034982573, - "findingsPerFunction": 0.09719675137542573 + "scorePerFile": 0.8434318555008208, + "scorePerKloc": 6.461575233039386, + "scorePerFunction": 0.26213319724419487, + "findingsPerFile": 0.21839080459770116, + "findingsPerKloc": 1.6731032921137712, + "findingsPerFunction": 0.06787445776983925 } }, "blended": { - "vsCurrentCohort": 2.9120710387841258, - "vsPinnedBaseline": 3.07065229655315 + "vsCurrentCohort": 4.154997740392929, + "vsPinnedBaseline": 5.056427166358941 }, "ruleCounts": { - "structure.duplicate-function-signatures": 61, + "api.generic-status-envelopes": 43, "defensive.empty-catch": 41, "defensive.promise-default-fallbacks": 40, - "api.generic-status-envelopes": 39, - "structure.barrel-density": 35, + "structure.pass-through-wrappers": 33, + "tests.duplicate-mock-setup": 31, "defensive.error-obscuring": 30, - "structure.pass-through-wrappers": 29, - "tests.duplicate-mock-setup": 28, - "defensive.stringified-unknown-errors": 21, - "structure.directory-fanout-hotspot": 17, + "defensive.stringified-unknown-errors": 22, "defensive.error-swallowing": 13, - "types.generic-record-casts": 12, - "defensive.async-noise": 5 + "types.generic-record-casts": 13 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "f7f4814182e1ad249a9ea15951a1fb5ca4362411", - "blendedVsPinnedBaseline": 3.07065229655315 + "ref": "3dd1a1f70ec55afe851138ea15ae01eb805d8673", + "blendedVsPinnedBaseline": 5.056427166358941 }, "series": [ { @@ -1576,42 +1555,42 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 2.9120710387841258, - "blendedVsPinnedBaseline": 3.07065229655315, - "repoScore": 1360.345634920635, - "findingCount": 371 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 4.154997740392929, + "blendedVsPinnedBaseline": 5.056427166358941, + "repoScore": 1027.2999999999997, + "findingCount": 266 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 0.8187540213234414, - "blendedVsPinnedBaseline": 0.8960692203116105, - "repoScore": 573.093055555556, - "findingCount": 132, - "fileCount": 120, - "logicalLineCount": 35094, - "functionCount": 304, - "scorePerFile": 0.40685215337303615, - "scorePerKloc": 2.209874843029283, - "scorePerFunction": 0.13229436292205018, - "findingsPerFile": 0.08829384954422517, - "findingsPerKloc": 0.40090802687706883, - "findingsPerFunction": 0.029163731164779563 + "blendedVsCurrentCohort": 2.0616807229322447, + "blendedVsPinnedBaseline": 2.8818440901174016, + "repoScore": 240.04742063492085, + "findingCount": 27, + "fileCount": 146, + "logicalLineCount": 38574, + "functionCount": 406, + "scorePerFile": 0.10905444937668007, + "scorePerKloc": -0.07641582570126193, + "scorePerFunction": 0.03803624894784449, + "findingsPerFile": -0.004556956596328682, + "findingsPerKloc": -0.31174871599173315, + "findingsPerFunction": -0.00015856244080691972 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.975816126767741, - "blendedVsPinnedBaseline": 1.0576103996758515, - "repoScore": 565.1972222222224, - "findingCount": 128, - "fileCount": 60, - "logicalLineCount": 11846, - "functionCount": 159, - "scorePerFile": 0.43880163308515174, - "scorePerKloc": 3.212933333912402, - "scorePerFunction": 0.13901886378854478, - "findingsPerFile": 0.09657729978419141, - "findingsPerKloc": 0.6942662301656444, - "findingsPerFunction": 0.030767008346448146 + "blendedVsCurrentCohort": 2.218742828376544, + "blendedVsPinnedBaseline": 3.0433852694816426, + "repoScore": 232.15158730158726, + "findingCount": 23, + "fileCount": 86, + "logicalLineCount": 15326, + "functionCount": 261, + "scorePerFile": 0.14100392908879567, + "scorePerKloc": 0.9266426651818573, + "scorePerFunction": 0.044760749814339085, + "findingsPerFile": 0.0037264936436375573, + "findingsPerKloc": -0.018390512703157613, + "findingsPerFunction": 0.0014447147408616634 } }, { @@ -1620,7 +1599,7 @@ "cohort": "explicit-ai", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -1721,61 +1700,55 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "vinext", "repo": "cloudflare/vinext", "cohort": "explicit-ai", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "bc03bf1c7138a2ca62b35ad163338d89ca3de145", + "ref": "67a929bf25727904f1896fe3626fd914be7228a4", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 1187, - "directoryCount": 506, - "findingCount": 221, - "repoScore": 711.805339105339, - "physicalLineCount": 159077, - "logicalLineCount": 63673, - "functionCount": 3170, + "fileCount": 1226, + "directoryCount": 530, + "findingCount": 149, + "repoScore": 487.7, + "physicalLineCount": 162437, + "logicalLineCount": 64952, + "functionCount": 3267, "normalized": { - "scorePerFile": 0.5996675139893336, - "scorePerKloc": 11.17907651760305, - "scorePerFunction": 0.22454427101114796, - "findingsPerFile": 0.18618365627632688, - "findingsPerKloc": 3.470858919793319, - "findingsPerFunction": 0.06971608832807571 + "scorePerFile": 0.3977977161500816, + "scorePerKloc": 7.508621751447222, + "scorePerFunction": 0.149280685644322, + "findingsPerFile": 0.12153344208809136, + "findingsPerKloc": 2.2940017243502897, + "findingsPerFunction": 0.045607591062136514 } }, "blended": { - "vsCurrentCohort": 2.332529928593622, - "vsPinnedBaseline": 2.459551393706888 + "vsCurrentCohort": 3.061497732405407, + "vsPinnedBaseline": 3.7256916299591216 }, "ruleCounts": { - "structure.duplicate-function-signatures": 50, "defensive.promise-default-fallbacks": 32, + "defensive.error-obscuring": 29, "structure.pass-through-wrappers": 29, - "defensive.error-obscuring": 26, "tests.duplicate-mock-setup": 20, "defensive.empty-catch": 18, - "structure.directory-fanout-hotspot": 15, - "defensive.stringified-unknown-errors": 11, + "defensive.stringified-unknown-errors": 12, "api.generic-status-envelopes": 5, - "defensive.async-noise": 4, - "structure.barrel-density": 3, - "structure.over-fragmentation": 3, "defensive.error-swallowing": 2, - "types.generic-record-casts": 2, - "comments.placeholder-comments": 1 + "types.generic-record-casts": 2 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "bc03bf1c7138a2ca62b35ad163338d89ca3de145", - "blendedVsPinnedBaseline": 2.459551393706888 + "ref": "67a929bf25727904f1896fe3626fd914be7228a4", + "blendedVsPinnedBaseline": 3.7256916299591216 }, "series": [ { @@ -1812,42 +1785,42 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 2.332529928593622, - "blendedVsPinnedBaseline": 2.459551393706888, - "repoScore": 711.805339105339, - "findingCount": 221 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 3.061497732405407, + "blendedVsPinnedBaseline": 3.7256916299591216, + "repoScore": 487.7, + "findingCount": 149 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 0.4290760167292753, - "blendedVsPinnedBaseline": 0.47201551944147724, - "repoScore": 211.9815462315462, - "findingCount": 68, - "fileCount": 138, - "logicalLineCount": 8145, - "functionCount": 528, - "scorePerFile": 0.12319106701717647, - "scorePerKloc": 2.1777836045899246, - "scorePerFunction": 0.0353603978567979, - "findingsPerFile": 0.04033046275869104, - "findingsPerKloc": 0.7154922579290344, - "findingsPerFunction": 0.011805414596054518 + "blendedVsCurrentCohort": 1.1580438205410604, + "blendedVsPinnedBaseline": 1.738155755693711, + "repoScore": -12.123792873792866, + "findingCount": -4, + "fileCount": 177, + "logicalLineCount": 9424, + "functionCount": 625, + "scorePerFile": -0.07867873082207555, + "scorePerKloc": -1.4926711615659034, + "scorePerFunction": -0.039903187510028054, + "findingsPerFile": -0.024319751429544484, + "findingsPerKloc": -0.461364937513995, + "findingsPerFunction": -0.012303082669884682 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.4786580102538591, - "blendedVsPinnedBaseline": 0.5321595921925566, - "repoScore": 159.91666666666663, - "findingCount": 54, - "fileCount": 13, - "logicalLineCount": 1521, - "functionCount": 110, - "scorePerFile": 0.12957494802794312, - "scorePerKloc": 2.2994158077518403, - "scorePerFunction": 0.04418849570439226, - "findingsPerFile": 0.043934933959461464, - "findingsPerKloc": 0.7838979209517696, - "findingsPerFunction": 0.015140924929382904 + "blendedVsCurrentCohort": 1.2076258140656442, + "blendedVsPinnedBaseline": 1.7982998284447904, + "repoScore": -64.18867243867243, + "findingCount": -18, + "fileCount": 52, + "logicalLineCount": 2800, + "functionCount": 207, + "scorePerFile": -0.0722948498113089, + "scorePerKloc": -1.3710389584039877, + "scorePerFunction": -0.03107508966243369, + "findingsPerFile": -0.020715280228774058, + "findingsPerKloc": -0.3929592744912598, + "findingsPerFunction": -0.008967572336556297 } }, { @@ -1856,7 +1829,7 @@ "cohort": "explicit-ai", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -1949,7 +1922,7 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "hunk", "repo": "modem-dev/hunk", @@ -1958,27 +1931,27 @@ "defaultBranch": "main", "ref": "a6aa1cb8791fa90c71c68fc41a2eee77752c3e6a", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { "fileCount": 212, "directoryCount": 43, - "findingCount": 47, - "repoScore": 126.82689075630253, + "findingCount": 37, + "repoScore": 102.60000000000001, "physicalLineCount": 40479, "logicalLineCount": 17410, "functionCount": 940, "normalized": { - "scorePerFile": 0.598240050737276, - "scorePerKloc": 7.284715149701467, - "scorePerFunction": 0.1349222242088325, - "findingsPerFile": 0.22169811320754718, - "findingsPerKloc": 2.6995979322228605, - "findingsPerFunction": 0.05 + "scorePerFile": 0.48396226415094346, + "scorePerKloc": 5.893164847788627, + "scorePerFunction": 0.10914893617021278, + "findingsPerFile": 0.17452830188679244, + "findingsPerKloc": 2.1252153934520392, + "findingsPerFunction": 0.039361702127659576 } }, "blended": { - "vsCurrentCohort": 1.8628276339934124, - "vsPinnedBaseline": 1.9642707462221969 + "vsCurrentCohort": 2.9507258067064672, + "vsPinnedBaseline": 3.5908876638994305 }, "ruleCounts": { "defensive.error-obscuring": 10, @@ -1986,21 +1959,17 @@ "structure.pass-through-wrappers": 7, "defensive.stringified-unknown-errors": 5, "defensive.promise-default-fallbacks": 3, - "structure.barrel-density": 3, - "structure.directory-fanout-hotspot": 3, - "structure.duplicate-function-signatures": 3, "types.generic-record-casts": 3, "api.generic-status-envelopes": 1, - "defensive.async-noise": 1, "defensive.error-swallowing": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", "ref": "a6aa1cb8791fa90c71c68fc41a2eee77752c3e6a", - "blendedVsPinnedBaseline": 1.9642707462221969 + "blendedVsPinnedBaseline": 3.5908876638994305 }, "series": [ { @@ -2037,42 +2006,42 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 1.8628276339934124, - "blendedVsPinnedBaseline": 1.9642707462221969, - "repoScore": 126.82689075630253, - "findingCount": 47 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 2.9507258067064672, + "blendedVsPinnedBaseline": 3.5908876638994305, + "repoScore": 102.60000000000001, + "findingCount": 37 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 1.0948067043404208, - "blendedVsPinnedBaseline": 1.1623237485263689, - "repoScore": 97.43598166539344, - "findingCount": 38, + "blendedVsCurrentCohort": 2.182704877053476, + "blendedVsPinnedBaseline": 2.7889406662036027, + "repoScore": 73.20909090909092, + "findingCount": 28, "fileCount": 88, "logicalLineCount": 9598, "functionCount": 448, - "scorePerFile": 0.3612165903267189, - "scorePerKloc": 3.5224380003275435, - "scorePerFunction": 0.07518460410535874, - "findingsPerFile": 0.14911746804625686, - "findingsPerKloc": 1.5475241995039666, - "findingsPerFunction": 0.03170731707317073 + "scorePerFile": 0.2469388037403863, + "scorePerKloc": 2.1308876984147043, + "scorePerFunction": 0.04941131606673902, + "findingsPerFile": 0.10194765672550211, + "findingsPerKloc": 0.9731416607331453, + "findingsPerFunction": 0.02106901920083031 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.40658134145161995, - "blendedVsPinnedBaseline": 0.45027339966101376, - "repoScore": 37.927287581699346, - "findingCount": 16, + "blendedVsCurrentCohort": 1.4944795141646747, + "blendedVsPinnedBaseline": 2.0768903173382474, + "repoScore": 13.700396825396822, + "findingCount": 6, "fileCount": 26, "logicalLineCount": 2165, "functionCount": 100, - "scorePerFile": 0.12028519495983958, - "scorePerKloc": 1.4533210418232647, - "scorePerFunction": 0.029089363286685835, - "findingsPerFile": 0.05503144654088052, - "findingsPerKloc": 0.6661443408814369, - "findingsPerFunction": 0.013095238095238097 + "scorePerFile": 0.006007408373506995, + "scorePerKloc": 0.061770739910425476, + "scorePerFunction": 0.003316075248066125, + "findingsPerFile": 0.007861635220125784, + "findingsPerKloc": 0.09176180211061569, + "findingsPerFunction": 0.0024569402228976703 } }, { @@ -2081,7 +2050,7 @@ "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -2182,58 +2151,54 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "vite", "repo": "vitejs/vite", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "3770a53064e8da27d4cb8d595a2b038413e6abdb", + "ref": "640202a2167b0c19b94e4d3b8ff87309ae1f44d0", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 1440, - "directoryCount": 623, - "findingCount": 125, - "repoScore": 399.5909370467554, - "physicalLineCount": 96101, - "logicalLineCount": 46751, - "functionCount": 2308, + "fileCount": 1442, + "directoryCount": 625, + "findingCount": 72, + "repoScore": 223.4, + "physicalLineCount": 96133, + "logicalLineCount": 46804, + "functionCount": 2307, "normalized": { - "scorePerFile": 0.27749370628246905, - "scorePerKloc": 8.547216894756378, - "scorePerFunction": 0.17313298832181778, - "findingsPerFile": 0.08680555555555555, - "findingsPerKloc": 2.6737395991529596, - "findingsPerFunction": 0.05415944540727903 + "scorePerFile": 0.1549237170596394, + "scorePerKloc": 4.773096316554141, + "scorePerFunction": 0.09683571738188124, + "findingsPerFile": 0.049930651872399444, + "findingsPerKloc": 1.538330057260063, + "findingsPerFunction": 0.031209362808842653 } }, "blended": { - "vsCurrentCohort": 1.5184668649766124, - "vsPinnedBaseline": 1.6011572877449798 + "vsCurrentCohort": 1.709166473326745, + "vsPinnedBaseline": 2.0799712364565517 }, "ruleCounts": { "structure.pass-through-wrappers": 27, - "structure.directory-fanout-hotspot": 20, "defensive.empty-catch": 15, - "structure.barrel-density": 11, "defensive.error-obscuring": 10, - "defensive.async-noise": 9, - "structure.over-fragmentation": 8, "defensive.error-swallowing": 6, - "structure.duplicate-function-signatures": 6, "tests.duplicate-mock-setup": 6, "defensive.promise-default-fallbacks": 4, - "api.generic-status-envelopes": 3 + "api.generic-status-envelopes": 3, + "defensive.stringified-unknown-errors": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "3770a53064e8da27d4cb8d595a2b038413e6abdb", - "blendedVsPinnedBaseline": 1.6011572877449798 + "ref": "640202a2167b0c19b94e4d3b8ff87309ae1f44d0", + "blendedVsPinnedBaseline": 2.0799712364565517 }, "series": [ { @@ -2270,42 +2235,42 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 1.5184668649766124, - "blendedVsPinnedBaseline": 1.6011572877449798, - "repoScore": 399.5909370467554, - "findingCount": 125 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 1.709166473326745, + "blendedVsPinnedBaseline": 2.0799712364565517, + "repoScore": 223.4, + "findingCount": 72 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 0.06403771734376784, - "blendedVsPinnedBaseline": 0.08248111204172748, - "repoScore": 18.947058823529346, - "findingCount": 10, - "fileCount": 20, - "logicalLineCount": 769, - "functionCount": 20, - "scorePerFile": 0.009434637111183086, - "scorePerKloc": 0.2691107179213983, - "scorePerFunction": 0.00676765693054765, - "findingsPerFile": 0.005819640062597803, - "findingsPerKloc": 0.17276095533581382, - "findingsPerFunction": 0.00389720764504127 + "blendedVsCurrentCohort": 0.2547373256939005, + "blendedVsPinnedBaseline": 0.5612950607532994, + "repoScore": -157.24387822322606, + "findingCount": -43, + "fileCount": 22, + "logicalLineCount": 822, + "functionCount": 19, + "scorePerFile": -0.11313535211164658, + "scorePerKloc": -3.505009860280839, + "scorePerFunction": -0.0695296140093889, + "findingsPerFile": -0.031055263620558306, + "findingsPerKloc": -0.9626485865570826, + "findingsPerFunction": -0.019052874953395107 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.060457772821721045, - "blendedVsPinnedBaseline": 0.08532723338538428, - "repoScore": 17.899999999999977, - "findingCount": 8, - "fileCount": 2, - "logicalLineCount": 86, - "functionCount": 1, - "scorePerFile": 0.012061900269426329, - "scorePerKloc": 0.36783326576772524, - "scorePerFunction": 0.007683947555994025, - "findingsPerFile": 0.005442551383093797, - "findingsPerKloc": 0.1665071979957755, - "findingsPerFunction": 0.0034442308429097207 + "blendedVsCurrentCohort": 0.2511573811718537, + "blendedVsPinnedBaseline": 0.5641411820969562, + "repoScore": -158.29093704675543, + "findingCount": -45, + "fileCount": 4, + "logicalLineCount": 139, + "functionCount": 0, + "scorePerFile": -0.11050808895340333, + "scorePerKloc": -3.406287312434512, + "scorePerFunction": -0.06861332338394252, + "findingsPerFile": -0.03143235230006231, + "findingsPerKloc": -0.9689023438971209, + "findingsPerFunction": -0.019505851755526656 } }, { @@ -2314,7 +2279,7 @@ "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -2413,57 +2378,52 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "astro", "repo": "withastro/astro", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "05e70f7751b15486d876bac26582fc712a24fd49", + "ref": "1058428df2d13878c6130787636dd1778273a934", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 2764, - "directoryCount": 1111, - "findingCount": 282, - "repoScore": 783.7111471861468, - "physicalLineCount": 227465, - "logicalLineCount": 132317, - "functionCount": 4387, + "fileCount": 2765, + "directoryCount": 1109, + "findingCount": 162, + "repoScore": 459.39999999999975, + "physicalLineCount": 227813, + "logicalLineCount": 132911, + "functionCount": 4391, "normalized": { - "scorePerFile": 0.2835423832077232, - "scorePerKloc": 5.9229815306132, - "scorePerFunction": 0.17864398157878889, - "findingsPerFile": 0.1020260492040521, - "findingsPerKloc": 2.131245418200231, - "findingsPerFunction": 0.0642808297241851 + "scorePerFile": 0.1661482820976491, + "scorePerKloc": 3.456448299990217, + "scorePerFunction": 0.10462309268959229, + "findingsPerFile": 0.058589511754068714, + "findingsPerKloc": 1.2188607413983794, + "findingsPerFunction": 0.036893646094283764 } }, "blended": { - "vsCurrentCohort": 1.4667891604816459, - "vsPinnedBaseline": 1.546665395248319 + "vsCurrentCohort": 1.6862487641081452, + "vsPinnedBaseline": 2.052081515517092 }, "ruleCounts": { "structure.pass-through-wrappers": 56, - "defensive.empty-catch": 46, - "structure.duplicate-function-signatures": 37, + "defensive.empty-catch": 47, "defensive.error-obscuring": 34, - "structure.directory-fanout-hotspot": 32, - "structure.barrel-density": 29, - "defensive.async-noise": 22, "defensive.promise-default-fallbacks": 12, "defensive.error-swallowing": 10, - "defensive.stringified-unknown-errors": 3, - "structure.over-fragmentation": 1 + "defensive.stringified-unknown-errors": 3 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "05e70f7751b15486d876bac26582fc712a24fd49", - "blendedVsPinnedBaseline": 1.546665395248319 + "ref": "1058428df2d13878c6130787636dd1778273a934", + "blendedVsPinnedBaseline": 2.052081515517092 }, "series": [ { @@ -2500,98 +2460,90 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 1.4667891604816459, - "blendedVsPinnedBaseline": 1.546665395248319, - "repoScore": 783.7111471861468, - "findingCount": 282 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 1.6862487641081452, + "blendedVsPinnedBaseline": 2.052081515517092, + "repoScore": 459.39999999999975, + "findingCount": 162 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": -0.013999099471519116, - "blendedVsPinnedBaseline": 0.0004657365629570087, - "repoScore": 13.919480519480544, - "findingCount": 12, - "fileCount": 25, - "logicalLineCount": 5518, - "functionCount": 170, - "scorePerFile": 0.002493947038805233, - "scorePerKloc": -0.14797854530748022, - "scorePerFunction": -0.003900876535194109, - "findingsPerFile": 0.0034499265315438843, - "findingsPerKloc": 0.001891085752814714, - "findingsPerFunction": 0.00025427055890171746 + "blendedVsCurrentCohort": 0.20546050415498018, + "blendedVsPinnedBaseline": 0.50588185683173, + "repoScore": -310.39166666666654, + "findingCount": -108, + "fileCount": 26, + "logicalLineCount": 6112, + "functionCount": 174, + "scorePerFile": -0.11490015407126886, + "scorePerKloc": -2.614511775930463, + "scorePerFunction": -0.07792176542439071, + "findingsPerFile": -0.039986610918439504, + "findingsPerKloc": -0.910493591049037, + "findingsPerFunction": -0.027132913070999617 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.06220057294067449, - "blendedVsPinnedBaseline": 0.08637436794180897, - "repoScore": 38, - "findingCount": 17, - "fileCount": -41, - "logicalLineCount": 736, - "functionCount": 20, - "scorePerFile": 0.017691706849025546, - "scorePerKloc": 0.25566522213289566, - "scorePerFunction": 0.007883471575091422, - "findingsPerFile": 0.007551895906369399, - "findingsPerKloc": 0.11727683611011175, - "findingsPerFunction": 0.0035984390669833582 + "blendedVsCurrentCohort": 0.2816601765671738, + "blendedVsPinnedBaseline": 0.591790488210582, + "repoScore": -286.3111471861471, + "findingCount": -103, + "fileCount": -40, + "logicalLineCount": 1330, + "functionCount": 24, + "scorePerFile": -0.09970239426104854, + "scorePerKloc": -2.210868008490087, + "scorePerFunction": -0.06613741731410518, + "findingsPerFile": -0.03588464154361399, + "findingsPerKloc": -0.79510784069174, + "findingsPerFunction": -0.023788744562917977 } }, { - "id": "payload", - "repo": "payloadcms/payload", + "id": "tsup", + "repo": "egoist/tsup", "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-03-23T12:00:00Z", "periodStart": "2026-03-23", - "repoId": "payload", - "repo": "payloadcms/payload", + "repoId": "tsup", + "repo": "egoist/tsup", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "167a01eb0ca69894bfc44e2f8b605148ab646922", + "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 6097, - "directoryCount": 2520, - "findingCount": 495, - "repoScore": 1462.67181013431, - "physicalLineCount": 738583, - "logicalLineCount": 461694, - "functionCount": 5432, + "fileCount": 48, + "directoryCount": 8, + "findingCount": 4, + "repoScore": 10.142857142857142, + "physicalLineCount": 6686, + "logicalLineCount": 2813, + "functionCount": 140, "normalized": { - "scorePerFile": 0.23990024768481383, - "scorePerKloc": 3.1680546208837668, - "scorePerFunction": 0.2692694790379805, - "findingsPerFile": 0.08118746924717074, - "findingsPerKloc": 1.0721386892617188, - "findingsPerFunction": 0.09112665684830633 + "scorePerFile": 0.2113095238095238, + "scorePerKloc": 3.605708191559595, + "scorePerFunction": 0.07244897959183673, + "findingsPerFile": 0.08333333333333333, + "findingsPerKloc": 1.4219694276573054, + "findingsPerFunction": 0.02857142857142857 } }, "blended": { - "vsCurrentCohort": 1.264525566857393, - "vsPinnedBaseline": 1.3203839149397734 + "vsCurrentCohort": 0.8819800871953896, + "vsPinnedBaseline": 0.9209401145791967 }, "ruleCounts": { - "structure.duplicate-function-signatures": 177, - "structure.directory-fanout-hotspot": 95, - "structure.barrel-density": 62, - "defensive.empty-catch": 39, - "defensive.error-obscuring": 37, - "defensive.error-swallowing": 35, - "structure.pass-through-wrappers": 20, - "structure.over-fragmentation": 12, - "tests.duplicate-mock-setup": 10, - "defensive.async-noise": 7, - "comments.placeholder-comments": 1 + "structure.pass-through-wrappers": 2, + "defensive.error-obscuring": 1, + "structure.directory-fanout-hotspot": 1 } }, "previous": { @@ -2600,179 +2552,159 @@ "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-04-13T12:00:00Z", "periodStart": "2026-04-13", - "repoId": "payload", - "repo": "payloadcms/payload", + "repoId": "tsup", + "repo": "egoist/tsup", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "5afcef5d85d596b0536d02e10bb3e7d254d48bc8", + "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 6250, - "directoryCount": 2578, - "findingCount": 513, - "repoScore": 1525.0410561660556, - "physicalLineCount": 754256, - "logicalLineCount": 469447, - "functionCount": 5558, + "fileCount": 48, + "directoryCount": 8, + "findingCount": 4, + "repoScore": 10.142857142857142, + "physicalLineCount": 6686, + "logicalLineCount": 2813, + "functionCount": 140, "normalized": { - "scorePerFile": 0.2440065689865689, - "scorePerKloc": 3.2485904823463683, - "scorePerFunction": 0.274386659979499, - "findingsPerFile": 0.08208, - "findingsPerKloc": 1.092775116253805, - "findingsPerFunction": 0.09229938826916156 + "scorePerFile": 0.2113095238095238, + "scorePerKloc": 3.605708191559595, + "scorePerFunction": 0.07244897959183673, + "findingsPerFile": 0.08333333333333333, + "findingsPerKloc": 1.4219694276573054, + "findingsPerFunction": 0.02857142857142857 } }, "blended": { - "vsCurrentCohort": 1.2921562583044328, - "vsPinnedBaseline": 1.3433999155463558 + "vsCurrentCohort": 0.8858110818721784, + "vsPinnedBaseline": 0.9209401145791967 }, "ruleCounts": { - "structure.duplicate-function-signatures": 177, - "structure.directory-fanout-hotspot": 102, - "structure.barrel-density": 66, - "defensive.empty-catch": 42, - "defensive.error-obscuring": 40, - "defensive.error-swallowing": 35, - "structure.pass-through-wrappers": 20, - "structure.over-fragmentation": 13, - "tests.duplicate-mock-setup": 10, - "defensive.async-noise": 7, - "comments.placeholder-comments": 1 + "structure.pass-through-wrappers": 2, + "defensive.error-obscuring": 1, + "structure.directory-fanout-hotspot": 1 } }, "latest": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", - "repoId": "payload", - "repo": "payloadcms/payload", + "repoId": "tsup", + "repo": "egoist/tsup", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "48db8c199fe9aeb9f88d32daac40b7727c4a5ca8", + "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 6310, - "directoryCount": 2592, - "findingCount": 563, - "repoScore": 1705.804487179487, - "physicalLineCount": 764044, - "logicalLineCount": 473553, - "functionCount": 5618, + "fileCount": 48, + "directoryCount": 8, + "findingCount": 3, + "repoScore": 7, + "physicalLineCount": 6686, + "logicalLineCount": 2813, + "functionCount": 140, "normalized": { - "scorePerFile": 0.2703335161932626, - "scorePerKloc": 3.6021405992137883, - "scorePerFunction": 0.3036319841900119, - "findingsPerFile": 0.08922345483359746, - "findingsPerKloc": 1.1888848766663922, - "findingsPerFunction": 0.10021359914560342 + "scorePerFile": 0.14583333333333334, + "scorePerKloc": 2.4884464984002843, + "scorePerFunction": 0.05, + "findingsPerFile": 0.0625, + "findingsPerKloc": 1.066477070742979, + "findingsPerFunction": 0.02142857142857143 } }, "blended": { - "vsCurrentCohort": 1.3979699200225955, - "vsPinnedBaseline": 1.4740984983738326 + "vsCurrentCohort": 1.2472067522365113, + "vsPinnedBaseline": 1.5177890574444977 }, "ruleCounts": { - "structure.duplicate-function-signatures": 184, - "structure.directory-fanout-hotspot": 103, - "structure.barrel-density": 67, - "defensive.empty-catch": 44, - "defensive.error-obscuring": 41, - "defensive.error-swallowing": 35, - "structure.pass-through-wrappers": 20, - "api.generic-status-envelopes": 16, - "structure.over-fragmentation": 13, - "tests.duplicate-mock-setup": 13, - "defensive.promise-default-fallbacks": 10, - "defensive.stringified-unknown-errors": 9, - "defensive.async-noise": 7, - "comments.placeholder-comments": 1 + "structure.pass-through-wrappers": 2, + "defensive.error-obscuring": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", - "ref": "48db8c199fe9aeb9f88d32daac40b7727c4a5ca8", - "blendedVsPinnedBaseline": 1.4740984983738326 + "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", + "blendedVsPinnedBaseline": 1.5177890574444977 }, "series": [ { "periodStart": "2026-03-23", "recordedAt": "2026-03-23T12:00:00Z", - "blendedVsCurrentCohort": 1.264525566857393, - "blendedVsPinnedBaseline": 1.3203839149397734, - "repoScore": 1462.67181013431, - "findingCount": 495 + "blendedVsCurrentCohort": 0.8819800871953896, + "blendedVsPinnedBaseline": 0.9209401145791967, + "repoScore": 10.142857142857142, + "findingCount": 4 }, { "periodStart": "2026-03-30", "recordedAt": "2026-03-30T12:00:00Z", - "blendedVsCurrentCohort": 1.2750388200492768, - "blendedVsPinnedBaseline": 1.3248582583342952, - "repoScore": 1485.9218101343095, - "findingCount": 504 + "blendedVsCurrentCohort": 0.8863094520808851, + "blendedVsPinnedBaseline": 0.9209401145791967, + "repoScore": 10.142857142857142, + "findingCount": 4 }, { "periodStart": "2026-04-06", "recordedAt": "2026-04-06T12:00:00Z", - "blendedVsCurrentCohort": 1.2770550762355934, - "blendedVsPinnedBaseline": 1.3266324847342088, - "repoScore": 1495.1690323565317, - "findingCount": 506 + "blendedVsCurrentCohort": 0.8865237824083452, + "blendedVsPinnedBaseline": 0.9209401145791967, + "repoScore": 10.142857142857142, + "findingCount": 4 }, { "periodStart": "2026-04-13", "recordedAt": "2026-04-13T12:00:00Z", - "blendedVsCurrentCohort": 1.2921562583044328, - "blendedVsPinnedBaseline": 1.3433999155463558, - "repoScore": 1525.0410561660556, - "findingCount": 513 + "blendedVsCurrentCohort": 0.8858110818721784, + "blendedVsPinnedBaseline": 0.9209401145791967, + "repoScore": 10.142857142857142, + "findingCount": 4 }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 1.3979699200225955, - "blendedVsPinnedBaseline": 1.4740984983738326, - "repoScore": 1705.804487179487, - "findingCount": 563 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 1.2472067522365113, + "blendedVsPinnedBaseline": 1.5177890574444977, + "repoScore": 7, + "findingCount": 3 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 0.13344435316520253, - "blendedVsPinnedBaseline": 0.1537145834340592, - "repoScore": 243.13267704517716, - "findingCount": 68, - "fileCount": 213, - "logicalLineCount": 11859, - "functionCount": 186, - "scorePerFile": 0.030433268508448796, - "scorePerKloc": 0.4340859783300215, - "scorePerFunction": 0.03436250515203143, - "findingsPerFile": 0.008035985586426722, - "findingsPerKloc": 0.11674618740467335, - "findingsPerFunction": 0.00908694229729709 + "blendedVsCurrentCohort": 0.3652266650411218, + "blendedVsPinnedBaseline": 0.596848942865301, + "repoScore": -3.1428571428571423, + "findingCount": -1, + "fileCount": 0, + "logicalLineCount": 0, + "functionCount": 0, + "scorePerFile": -0.06547619047619047, + "scorePerKloc": -1.117261693159311, + "scorePerFunction": -0.022448979591836726, + "findingsPerFile": -0.02083333333333333, + "findingsPerKloc": -0.35549235691432646, + "findingsPerFunction": -0.007142857142857142 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.10581366171816264, - "blendedVsPinnedBaseline": 0.1306985828274767, - "repoScore": 180.7634310134315, - "findingCount": 50, - "fileCount": 60, - "logicalLineCount": 4106, - "functionCount": 60, - "scorePerFile": 0.026326947206693735, - "scorePerKloc": 0.35355011686742, - "scorePerFunction": 0.029245324210512902, - "findingsPerFile": 0.007143454833597462, - "findingsPerKloc": 0.09610976041258712, - "findingsPerFunction": 0.007914210876441855 + "blendedVsCurrentCohort": 0.36139567036433295, + "blendedVsPinnedBaseline": 0.596848942865301, + "repoScore": -3.1428571428571423, + "findingCount": -1, + "fileCount": 0, + "logicalLineCount": 0, + "functionCount": 0, + "scorePerFile": -0.06547619047619047, + "scorePerKloc": -1.117261693159311, + "scorePerFunction": -0.022448979591836726, + "findingsPerFile": -0.02083333333333333, + "findingsPerKloc": -0.35549235691432646, + "findingsPerFunction": -0.007142857142857142 } }, { @@ -2781,7 +2713,7 @@ "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -2874,40 +2806,38 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "zustand", "repo": "pmndrs/zustand", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "32013285083648e8d58ba1f76d73b9bdc02fef50", + "ref": "95d3f338c463f499aaa7a8dd5448c8b13a7dec0b", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 49, + "fileCount": 50, "directoryCount": 15, - "findingCount": 9, - "repoScore": 22.866666666666667, - "physicalLineCount": 9584, - "logicalLineCount": 7699, + "findingCount": 4, + "repoScore": 9.7, + "physicalLineCount": 9659, + "logicalLineCount": 7761, "functionCount": 171, "normalized": { - "scorePerFile": 0.4666666666666667, - "scorePerKloc": 2.9700826947222585, - "scorePerFunction": 0.13372319688109163, - "findingsPerFile": 0.1836734693877551, - "findingsPerKloc": 1.1689829848032212, - "findingsPerFunction": 0.05263157894736842 + "scorePerFile": 0.19399999999999998, + "scorePerKloc": 1.2498389382811492, + "scorePerFunction": 0.05672514619883041, + "findingsPerFile": 0.08, + "findingsPerKloc": 0.5153975003221234, + "findingsPerFunction": 0.023391812865497075 } }, "blended": { - "vsCurrentCohort": 1.3065300828667685, - "vsPinnedBaseline": 1.3776791658028045 + "vsCurrentCohort": 1.1154832958468233, + "vsPinnedBaseline": 1.3574881126664797 }, "ruleCounts": { - "structure.barrel-density": 3, - "structure.directory-fanout-hotspot": 2, "defensive.empty-catch": 1, "defensive.error-obscuring": 1, "defensive.error-swallowing": 1, @@ -2956,95 +2886,98 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 1.3065300828667685, - "blendedVsPinnedBaseline": 1.3776791658028045, - "repoScore": 22.866666666666667, - "findingCount": 9 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 1.1154832958468233, + "blendedVsPinnedBaseline": 1.3574881126664797, + "repoScore": 9.7, + "findingCount": 4 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": -0.01822261647126333, - "blendedVsPinnedBaseline": -0.005592316660030905, - "repoScore": 0, - "findingCount": 0, - "fileCount": 0, - "logicalLineCount": 93, + "blendedVsCurrentCohort": -0.2092694034912086, + "blendedVsPinnedBaseline": -0.02578336979635565, + "repoScore": -13.166666666666668, + "findingCount": -5, + "fileCount": 1, + "logicalLineCount": 155, "functionCount": 0, - "scorePerFile": 0, - "scorePerKloc": -0.036315762635967364, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": -0.01429337596459379, - "findingsPerFunction": 0 + "scorePerFile": -0.2726666666666667, + "scorePerKloc": -1.7565595190770766, + "scorePerFunction": -0.07699805068226123, + "findingsPerFile": -0.10367346938775511, + "findingsPerKloc": -0.6678788604456916, + "findingsPerFunction": -0.029239766081871343 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": -0.018597852178346086, - "blendedVsPinnedBaseline": 0, - "repoScore": 0, - "findingCount": 0, - "fileCount": 0, - "logicalLineCount": 0, + "blendedVsCurrentCohort": -0.20964463919829135, + "blendedVsPinnedBaseline": -0.020191053136324744, + "repoScore": -13.166666666666668, + "findingCount": -5, + "fileCount": 1, + "logicalLineCount": 62, "functionCount": 0, - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": 0 + "scorePerFile": -0.2726666666666667, + "scorePerKloc": -1.7202437564411093, + "scorePerFunction": -0.07699805068226123, + "findingsPerFile": -0.10367346938775511, + "findingsPerKloc": -0.6535854844810978, + "findingsPerFunction": -0.029239766081871343 } }, { - "id": "umami", - "repo": "umami-software/umami", + "id": "payload", + "repo": "payloadcms/payload", "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-03-23T12:00:00Z", "periodStart": "2026-03-23", - "repoId": "umami", - "repo": "umami-software/umami", + "repoId": "payload", + "repo": "payloadcms/payload", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "master", - "ref": "60376624db2159acefd91e13bb9498770464c37c", + "defaultBranch": "main", + "ref": "167a01eb0ca69894bfc44e2f8b605148ab646922", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 832, - "directoryCount": 196, - "findingCount": 59, - "repoScore": 151.86856060606064, - "physicalLineCount": 50570, - "logicalLineCount": 32880, - "functionCount": 1556, + "fileCount": 6097, + "directoryCount": 2520, + "findingCount": 495, + "repoScore": 1462.67181013431, + "physicalLineCount": 738583, + "logicalLineCount": 461694, + "functionCount": 5432, "normalized": { - "scorePerFile": 0.1825343276515152, - "scorePerKloc": 4.618873497751236, - "scorePerFunction": 0.0976019027031238, - "findingsPerFile": 0.07091346153846154, - "findingsPerKloc": 1.7944038929440387, - "findingsPerFunction": 0.037917737789203085 + "scorePerFile": 0.23990024768481383, + "scorePerKloc": 3.1680546208837668, + "scorePerFunction": 0.2692694790379805, + "findingsPerFile": 0.08118746924717074, + "findingsPerKloc": 1.0721386892617188, + "findingsPerFunction": 0.09112665684830633 } }, "blended": { - "vsCurrentCohort": 1, - "vsPinnedBaseline": 1.0441733639448667 + "vsCurrentCohort": 1.264525566857393, + "vsPinnedBaseline": 1.3203839149397734 }, "ruleCounts": { - "structure.duplicate-function-signatures": 23, - "structure.directory-fanout-hotspot": 11, - "defensive.error-obscuring": 9, - "structure.pass-through-wrappers": 6, - "structure.barrel-density": 5, - "defensive.empty-catch": 3, - "defensive.error-swallowing": 1, - "structure.over-fragmentation": 1 + "structure.duplicate-function-signatures": 177, + "structure.directory-fanout-hotspot": 95, + "structure.barrel-density": 62, + "defensive.empty-catch": 39, + "defensive.error-obscuring": 37, + "defensive.error-swallowing": 35, + "structure.pass-through-wrappers": 20, + "structure.over-fragmentation": 12, + "tests.duplicate-mock-setup": 10, + "defensive.async-noise": 7, + "comments.placeholder-comments": 1 } }, "previous": { @@ -3053,381 +2986,173 @@ "benchmarkSetName": "Known AI repos vs older solid OSS repos", "recordedAt": "2026-04-13T12:00:00Z", "periodStart": "2026-04-13", - "repoId": "umami", - "repo": "umami-software/umami", + "repoId": "payload", + "repo": "payloadcms/payload", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "master", - "ref": "3a31ad35b04b86651a39481bba62b83eda2a2204", + "defaultBranch": "main", + "ref": "5afcef5d85d596b0536d02e10bb3e7d254d48bc8", "analyzerVersion": "0.3.0", "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", "summary": { - "fileCount": 833, - "directoryCount": 195, - "findingCount": 59, - "repoScore": 151.86856060606064, - "physicalLineCount": 51206, - "logicalLineCount": 33079, - "functionCount": 1565, + "fileCount": 6250, + "directoryCount": 2578, + "findingCount": 513, + "repoScore": 1525.0410561660556, + "physicalLineCount": 754256, + "logicalLineCount": 469447, + "functionCount": 5558, "normalized": { - "scorePerFile": 0.18231519880679548, - "scorePerKloc": 4.591086810546288, - "scorePerFunction": 0.09704061380578954, - "findingsPerFile": 0.07082833133253301, - "findingsPerKloc": 1.783608936183077, - "findingsPerFunction": 0.03769968051118211 - } - }, - "blended": { - "vsCurrentCohort": 1, - "vsPinnedBaseline": 1.0396574771143894 - }, - "ruleCounts": { - "structure.duplicate-function-signatures": 23, - "structure.directory-fanout-hotspot": 11, - "defensive.error-obscuring": 9, - "structure.pass-through-wrappers": 6, - "structure.barrel-density": 5, - "defensive.empty-catch": 3, - "defensive.error-swallowing": 1, - "structure.over-fragmentation": 1 - } - }, - "latest": { - "schemaVersion": 1, - "benchmarkSetId": "known-ai-vs-solid-oss", - "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", - "periodStart": "2026-04-20", - "repoId": "umami", - "repo": "umami-software/umami", - "cohort": "mature-oss", - "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "master", - "ref": "c78ff36db0c82e13c86e5073020472c6546313a3", - "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", - "summary": { - "fileCount": 834, - "directoryCount": 195, - "findingCount": 60, - "repoScore": 153.8685606060606, - "physicalLineCount": 51283, - "logicalLineCount": 33141, - "functionCount": 1564, - "normalized": { - "scorePerFile": 0.1844946769856842, - "scorePerKloc": 4.642846039831647, - "scorePerFunction": 0.09838143261257072, - "findingsPerFile": 0.07194244604316546, - "findingsPerKloc": 1.8104462750067893, - "findingsPerFunction": 0.03836317135549872 - } - }, - "blended": { - "vsCurrentCohort": 1, - "vsPinnedBaseline": 1.0544565210315873 - }, - "ruleCounts": { - "structure.duplicate-function-signatures": 23, - "structure.directory-fanout-hotspot": 11, - "defensive.error-obscuring": 9, - "structure.pass-through-wrappers": 6, - "structure.barrel-density": 5, - "defensive.empty-catch": 3, - "defensive.error-swallowing": 1, - "defensive.promise-default-fallbacks": 1, - "structure.over-fragmentation": 1 - } - }, - "highest": { - "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "defaultBranch": "master", - "ref": "c78ff36db0c82e13c86e5073020472c6546313a3", - "blendedVsPinnedBaseline": 1.0544565210315873 - }, - "series": [ - { - "periodStart": "2026-03-23", - "recordedAt": "2026-03-23T12:00:00Z", - "blendedVsCurrentCohort": 1, - "blendedVsPinnedBaseline": 1.0441733639448667, - "repoScore": 151.86856060606064, - "findingCount": 59 - }, - { - "periodStart": "2026-03-30", - "recordedAt": "2026-03-30T12:00:00Z", - "blendedVsCurrentCohort": 1, - "blendedVsPinnedBaseline": 1.0390728795873785, - "repoScore": 151.86856060606064, - "findingCount": 59 - }, - { - "periodStart": "2026-04-06", - "recordedAt": "2026-04-06T12:00:00Z", - "blendedVsCurrentCohort": 1, - "blendedVsPinnedBaseline": 1.0388216682437506, - "repoScore": 151.86856060606064, - "findingCount": 59 - }, - { - "periodStart": "2026-04-13", - "recordedAt": "2026-04-13T12:00:00Z", - "blendedVsCurrentCohort": 1, - "blendedVsPinnedBaseline": 1.0396574771143894, - "repoScore": 151.86856060606064, - "findingCount": 59 - }, - { - "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 1, - "blendedVsPinnedBaseline": 1.0544565210315873, - "repoScore": 153.8685606060606, - "findingCount": 60 - } - ], - "deltaFromFirst": { - "blendedVsCurrentCohort": 0, - "blendedVsPinnedBaseline": 0.010283157086720562, - "repoScore": 1.9999999999999716, - "findingCount": 1, - "fileCount": 2, - "logicalLineCount": 261, - "functionCount": 8, - "scorePerFile": 0.001960349334168998, - "scorePerKloc": 0.02397254208041133, - "scorePerFunction": 0.0007795299094469216, - "findingsPerFile": 0.001028984504703928, - "findingsPerKloc": 0.01604238206275066, - "findingsPerFunction": 0.0004454335662956374 - }, - "deltaFromPrevious": { - "blendedVsCurrentCohort": 0, - "blendedVsPinnedBaseline": 0.014799043917197885, - "repoScore": 1.9999999999999716, - "findingCount": 1, - "fileCount": 1, - "logicalLineCount": 62, - "functionCount": -1, - "scorePerFile": 0.002179478178888722, - "scorePerKloc": 0.051759229285359254, - "scorePerFunction": 0.0013408188067811772, - "findingsPerFile": 0.001114114710632455, - "findingsPerKloc": 0.02683733882371242, - "findingsPerFunction": 0.0006634908443166124 - } - }, - { - "id": "tsup", - "repo": "egoist/tsup", - "cohort": "mature-oss", - "pointCount": 5, - "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", - "first": { - "schemaVersion": 1, - "benchmarkSetId": "known-ai-vs-solid-oss", - "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-03-23T12:00:00Z", - "periodStart": "2026-03-23", - "repoId": "tsup", - "repo": "egoist/tsup", - "cohort": "mature-oss", - "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "main", - "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", - "analyzerVersion": "0.3.0", - "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", - "summary": { - "fileCount": 48, - "directoryCount": 8, - "findingCount": 4, - "repoScore": 10.142857142857142, - "physicalLineCount": 6686, - "logicalLineCount": 2813, - "functionCount": 140, - "normalized": { - "scorePerFile": 0.2113095238095238, - "scorePerKloc": 3.605708191559595, - "scorePerFunction": 0.07244897959183673, - "findingsPerFile": 0.08333333333333333, - "findingsPerKloc": 1.4219694276573054, - "findingsPerFunction": 0.02857142857142857 - } - }, - "blended": { - "vsCurrentCohort": 0.8819800871953896, - "vsPinnedBaseline": 0.9209401145791967 - }, - "ruleCounts": { - "structure.pass-through-wrappers": 2, - "defensive.error-obscuring": 1, - "structure.directory-fanout-hotspot": 1 - } - }, - "previous": { - "schemaVersion": 1, - "benchmarkSetId": "known-ai-vs-solid-oss", - "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-13T12:00:00Z", - "periodStart": "2026-04-13", - "repoId": "tsup", - "repo": "egoist/tsup", - "cohort": "mature-oss", - "scanMode": "default-branch-as-of-recorded-at", - "defaultBranch": "main", - "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", - "analyzerVersion": "0.3.0", - "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", - "summary": { - "fileCount": 48, - "directoryCount": 8, - "findingCount": 4, - "repoScore": 10.142857142857142, - "physicalLineCount": 6686, - "logicalLineCount": 2813, - "functionCount": 140, - "normalized": { - "scorePerFile": 0.2113095238095238, - "scorePerKloc": 3.605708191559595, - "scorePerFunction": 0.07244897959183673, - "findingsPerFile": 0.08333333333333333, - "findingsPerKloc": 1.4219694276573054, - "findingsPerFunction": 0.02857142857142857 + "scorePerFile": 0.2440065689865689, + "scorePerKloc": 3.2485904823463683, + "scorePerFunction": 0.274386659979499, + "findingsPerFile": 0.08208, + "findingsPerKloc": 1.092775116253805, + "findingsPerFunction": 0.09229938826916156 } }, "blended": { - "vsCurrentCohort": 0.8858110818721784, - "vsPinnedBaseline": 0.9209401145791967 + "vsCurrentCohort": 1.2921562583044328, + "vsPinnedBaseline": 1.3433999155463558 }, "ruleCounts": { - "structure.pass-through-wrappers": 2, - "defensive.error-obscuring": 1, - "structure.directory-fanout-hotspot": 1 + "structure.duplicate-function-signatures": 177, + "structure.directory-fanout-hotspot": 102, + "structure.barrel-density": 66, + "defensive.empty-catch": 42, + "defensive.error-obscuring": 40, + "defensive.error-swallowing": 35, + "structure.pass-through-wrappers": 20, + "structure.over-fragmentation": 13, + "tests.duplicate-mock-setup": 10, + "defensive.async-noise": 7, + "comments.placeholder-comments": 1 } }, "latest": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", - "repoId": "tsup", - "repo": "egoist/tsup", + "repoId": "payload", + "repo": "payloadcms/payload", "cohort": "mature-oss", "scanMode": "default-branch-as-of-recorded-at", "defaultBranch": "main", - "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", + "ref": "0ceba0206fa838d66412640ad976e2572a97c768", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { - "fileCount": 48, - "directoryCount": 8, - "findingCount": 4, - "repoScore": 10.142857142857142, - "physicalLineCount": 6686, - "logicalLineCount": 2813, - "functionCount": 140, + "fileCount": 6125, + "directoryCount": 2500, + "findingCount": 189, + "repoScore": 629.6999999999998, + "physicalLineCount": 754798, + "logicalLineCount": 467009, + "functionCount": 5470, "normalized": { - "scorePerFile": 0.2113095238095238, - "scorePerKloc": 3.605708191559595, - "scorePerFunction": 0.07244897959183673, - "findingsPerFile": 0.08333333333333333, - "findingsPerKloc": 1.4219694276573054, - "findingsPerFunction": 0.02857142857142857 + "scorePerFile": 0.10280816326530609, + "scorePerKloc": 1.3483680186034954, + "scorePerFunction": 0.11511882998171843, + "findingsPerFile": 0.030857142857142857, + "findingsPerKloc": 0.40470312135312164, + "findingsPerFunction": 0.034552102376599635 } }, "blended": { - "vsCurrentCohort": 0.8733789361729491, - "vsPinnedBaseline": 0.9209401145791967 + "vsCurrentCohort": 1, + "vsPinnedBaseline": 1.2169506416821216 }, "ruleCounts": { - "structure.pass-through-wrappers": 2, - "defensive.error-obscuring": 1, - "structure.directory-fanout-hotspot": 1 + "defensive.empty-catch": 44, + "defensive.error-obscuring": 41, + "defensive.error-swallowing": 35, + "structure.pass-through-wrappers": 20, + "api.generic-status-envelopes": 16, + "tests.duplicate-mock-setup": 13, + "defensive.promise-default-fallbacks": 11, + "defensive.stringified-unknown-errors": 9 } }, "highest": { - "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "periodStart": "2026-04-13", + "recordedAt": "2026-04-13T12:00:00Z", "defaultBranch": "main", - "ref": "b906f86102c02f1ef66ebd4a3f7ff50bdc07af65", - "blendedVsPinnedBaseline": 0.9209401145791967 + "ref": "5afcef5d85d596b0536d02e10bb3e7d254d48bc8", + "blendedVsPinnedBaseline": 1.3433999155463558 }, "series": [ { "periodStart": "2026-03-23", "recordedAt": "2026-03-23T12:00:00Z", - "blendedVsCurrentCohort": 0.8819800871953896, - "blendedVsPinnedBaseline": 0.9209401145791967, - "repoScore": 10.142857142857142, - "findingCount": 4 + "blendedVsCurrentCohort": 1.264525566857393, + "blendedVsPinnedBaseline": 1.3203839149397734, + "repoScore": 1462.67181013431, + "findingCount": 495 }, { "periodStart": "2026-03-30", "recordedAt": "2026-03-30T12:00:00Z", - "blendedVsCurrentCohort": 0.8863094520808851, - "blendedVsPinnedBaseline": 0.9209401145791967, - "repoScore": 10.142857142857142, - "findingCount": 4 + "blendedVsCurrentCohort": 1.2750388200492768, + "blendedVsPinnedBaseline": 1.3248582583342952, + "repoScore": 1485.9218101343095, + "findingCount": 504 }, { "periodStart": "2026-04-06", "recordedAt": "2026-04-06T12:00:00Z", - "blendedVsCurrentCohort": 0.8865237824083452, - "blendedVsPinnedBaseline": 0.9209401145791967, - "repoScore": 10.142857142857142, - "findingCount": 4 + "blendedVsCurrentCohort": 1.2770550762355934, + "blendedVsPinnedBaseline": 1.3266324847342088, + "repoScore": 1495.1690323565317, + "findingCount": 506 }, { - "periodStart": "2026-04-13", - "recordedAt": "2026-04-13T12:00:00Z", - "blendedVsCurrentCohort": 0.8858110818721784, - "blendedVsPinnedBaseline": 0.9209401145791967, - "repoScore": 10.142857142857142, - "findingCount": 4 + "periodStart": "2026-04-13", + "recordedAt": "2026-04-13T12:00:00Z", + "blendedVsCurrentCohort": 1.2921562583044328, + "blendedVsPinnedBaseline": 1.3433999155463558, + "repoScore": 1525.0410561660556, + "findingCount": 513 }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 0.8733789361729491, - "blendedVsPinnedBaseline": 0.9209401145791967, - "repoScore": 10.142857142857142, - "findingCount": 4 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 1, + "blendedVsPinnedBaseline": 1.2169506416821216, + "repoScore": 629.6999999999998, + "findingCount": 189 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": -0.008601151022440412, - "blendedVsPinnedBaseline": 0, - "repoScore": 0, - "findingCount": 0, - "fileCount": 0, - "logicalLineCount": 0, - "functionCount": 0, - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": 0 + "blendedVsCurrentCohort": -0.2645255668573929, + "blendedVsPinnedBaseline": -0.10343327325765173, + "repoScore": -832.9718101343101, + "findingCount": -306, + "fileCount": 28, + "logicalLineCount": 5315, + "functionCount": 38, + "scorePerFile": -0.13709208441950774, + "scorePerKloc": -1.8196866022802713, + "scorePerFunction": -0.15415064905626205, + "findingsPerFile": -0.05033032639002788, + "findingsPerKloc": -0.6674355679085973, + "findingsPerFunction": -0.056574554471706694 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": -0.012432145699229236, - "blendedVsPinnedBaseline": 0, - "repoScore": 0, - "findingCount": 0, - "fileCount": 0, - "logicalLineCount": 0, - "functionCount": 0, - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": 0 + "blendedVsCurrentCohort": -0.2921562583044328, + "blendedVsPinnedBaseline": -0.1264492738642342, + "repoScore": -895.3410561660558, + "findingCount": -324, + "fileCount": -125, + "logicalLineCount": -2438, + "functionCount": -88, + "scorePerFile": -0.1411984057212628, + "scorePerKloc": -1.9002224637428728, + "scorePerFunction": -0.15926782999778058, + "findingsPerFile": -0.05122285714285714, + "findingsPerKloc": -0.6880719949006835, + "findingsPerFunction": -0.05774728589256193 } }, { @@ -3436,7 +3161,7 @@ "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -3529,7 +3254,7 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "execa", "repo": "sindresorhus/execa", @@ -3538,44 +3263,40 @@ "defaultBranch": "main", "ref": "f3a2e8481a1e9138de3895827895c834078b9456", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { "fileCount": 581, "directoryCount": 46, - "findingCount": 29, - "repoScore": 101.01486212489863, + "findingCount": 13, + "repoScore": 50.9, "physicalLineCount": 36103, "logicalLineCount": 20432, "functionCount": 1008, "normalized": { - "scorePerFile": 0.1738637902321835, - "scorePerKloc": 4.943953706191202, - "scorePerFunction": 0.10021315686993912, - "findingsPerFile": 0.04991394148020654, - "findingsPerKloc": 1.4193422083007048, - "findingsPerFunction": 0.028769841269841268 + "scorePerFile": 0.08760757314974182, + "scorePerKloc": 2.491190289741582, + "scorePerFunction": 0.05049603174603175, + "findingsPerFile": 0.022375215146299483, + "findingsPerKloc": 0.6362568519968677, + "findingsPerFunction": 0.012896825396825396 } }, "blended": { - "vsCurrentCohort": 0.8643335159262805, - "vsPinnedBaseline": 0.9114021122146257 + "vsCurrentCohort": 0.8153733768021222, + "vsPinnedBaseline": 0.992269154109861 }, "ruleCounts": { "defensive.empty-catch": 11, - "structure.directory-fanout-hotspot": 7, - "structure.duplicate-function-signatures": 6, - "structure.over-fragmentation": 2, "defensive.error-obscuring": 1, - "defensive.promise-default-fallbacks": 1, - "structure.barrel-density": 1 + "defensive.promise-default-fallbacks": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "main", "ref": "f3a2e8481a1e9138de3895827895c834078b9456", - "blendedVsPinnedBaseline": 0.9114021122146257 + "blendedVsPinnedBaseline": 0.992269154109861 }, "series": [ { @@ -3612,42 +3333,42 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 0.8643335159262805, - "blendedVsPinnedBaseline": 0.9114021122146257, - "repoScore": 101.01486212489863, - "findingCount": 29 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 0.8153733768021222, + "blendedVsPinnedBaseline": 0.992269154109861, + "repoScore": 50.9, + "findingCount": 13 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": 0.015201936325376919, - "blendedVsPinnedBaseline": 0.024761534310931865, - "repoScore": 2.000000000000014, - "findingCount": 1, + "blendedVsCurrentCohort": -0.03375820279878139, + "blendedVsPinnedBaseline": 0.10562857620616717, + "repoScore": -48.114862124898615, + "findingCount": -15, "fileCount": 0, "logicalLineCount": 0, "functionCount": 0, - "scorePerFile": 0.0034423407917383853, - "scorePerKloc": 0.09788566953798039, - "scorePerFunction": 0.001984126984127005, - "findingsPerFile": 0.0017211703958691857, - "findingsPerKloc": 0.04894283476898975, - "findingsPerFunction": 0.000992063492063492 + "scorePerFile": -0.0828138762907033, + "scorePerKloc": -2.3548777469116398, + "scorePerFunction": -0.04773299813978037, + "findingsPerFile": -0.02581755593803787, + "findingsPerKloc": -0.7341425215348474, + "findingsPerFunction": -0.01488095238095238 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": 0.011513623393405115, - "blendedVsPinnedBaseline": 0.024761534310931865, - "repoScore": 2.000000000000014, - "findingCount": 1, + "blendedVsCurrentCohort": -0.037446515730753194, + "blendedVsPinnedBaseline": 0.10562857620616717, + "repoScore": -48.114862124898615, + "findingCount": -15, "fileCount": 0, "logicalLineCount": 0, "functionCount": 0, - "scorePerFile": 0.0034423407917383853, - "scorePerKloc": 0.09788566953798039, - "scorePerFunction": 0.001984126984127005, - "findingsPerFile": 0.0017211703958691857, - "findingsPerKloc": 0.04894283476898975, - "findingsPerFunction": 0.000992063492063492 + "scorePerFile": -0.0828138762907033, + "scorePerKloc": -2.3548777469116398, + "scorePerFunction": -0.04773299813978037, + "findingsPerFile": -0.02581755593803787, + "findingsPerKloc": -0.7341425215348474, + "findingsPerFunction": -0.01488095238095238 } }, { @@ -3656,7 +3377,7 @@ "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -3739,7 +3460,7 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "node-notifier", "repo": "mikaelbr/node-notifier", @@ -3748,7 +3469,7 @@ "defaultBranch": "master", "ref": "b36c237f0d913f9df3a2bd45adc08b33ff717f6a", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { "fileCount": 24, "directoryCount": 5, @@ -3767,8 +3488,8 @@ } }, "blended": { - "vsCurrentCohort": 0.3912555646747709, - "vsPinnedBaseline": 0.41256198156120816 + "vsCurrentCohort": 0.7765988979179349, + "vsPinnedBaseline": 0.9450825271508594 }, "ruleCounts": { "defensive.empty-catch": 1 @@ -3776,10 +3497,10 @@ }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "master", "ref": "b36c237f0d913f9df3a2bd45adc08b33ff717f6a", - "blendedVsPinnedBaseline": 0.41256198156120816 + "blendedVsPinnedBaseline": 0.9450825271508594 }, "series": [ { @@ -3816,16 +3537,16 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 0.3912555646747709, - "blendedVsPinnedBaseline": 0.41256198156120816, + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 0.7765988979179349, + "blendedVsPinnedBaseline": 0.9450825271508594, "repoScore": 1.9000000000000001, "findingCount": 1 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": -0.003853136434551596, - "blendedVsPinnedBaseline": 0, + "blendedVsCurrentCohort": 0.3814901968086124, + "blendedVsPinnedBaseline": 0.5325205455896512, "repoScore": 0, "findingCount": 0, "fileCount": 0, @@ -3839,8 +3560,8 @@ "findingsPerFunction": 0 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": -0.005569342222729923, - "blendedVsPinnedBaseline": 0, + "blendedVsCurrentCohort": 0.3797739910204341, + "blendedVsPinnedBaseline": 0.5325205455896512, "repoScore": 0, "findingCount": 0, "fileCount": 0, @@ -3860,7 +3581,7 @@ "cohort": "mature-oss", "pointCount": 5, "firstRecordedAt": "2026-03-23T12:00:00Z", - "latestRecordedAt": "2026-04-20T12:22:33.984Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", "first": { "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", @@ -3951,7 +3672,7 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "periodStart": "2026-04-20", "repoId": "hyper", "repo": "vercel/hyper", @@ -3960,42 +3681,41 @@ "defaultBranch": "canary", "ref": "2a7bb18259d975f27b30b502af1be7576f6f5656", "analyzerVersion": "0.3.0", - "analyzerCommit": "df9e2d480c43ab6a1556caff16ab313302926a2a", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", "summary": { "fileCount": 113, "directoryCount": 21, - "findingCount": 18, - "repoScore": 73.10000000000001, + "findingCount": 17, + "repoScore": 71.60000000000001, "physicalLineCount": 162735, "logicalLineCount": 65075, "functionCount": 5354, "normalized": { - "scorePerFile": 0.6469026548672567, - "scorePerKloc": 1.1233192470226663, - "scorePerFunction": 0.013653343294732912, - "findingsPerFile": 0.1592920353982301, - "findingsPerKloc": 0.27660391855551286, - "findingsPerFunction": 0.0033619723571161747 + "scorePerFile": 0.6336283185840709, + "scorePerKloc": 1.1002689204763736, + "scorePerFunction": 0.013373178931639897, + "findingsPerFile": 0.1504424778761062, + "findingsPerKloc": 0.2612370341913177, + "findingsPerFunction": 0.003175196115054165 } }, "blended": { - "vsCurrentCohort": 0.38947254094340006, - "vsPinnedBaseline": 0.4106818605605101 + "vsCurrentCohort": 0.7435310633443125, + "vsPinnedBaseline": 0.9048406046474513 }, "ruleCounts": { "defensive.error-swallowing": 8, "structure.pass-through-wrappers": 5, "defensive.empty-catch": 3, - "defensive.async-noise": 1, "defensive.error-obscuring": 1 } }, "highest": { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", + "recordedAt": "2026-04-26T18:00:48.765Z", "defaultBranch": "canary", "ref": "2a7bb18259d975f27b30b502af1be7576f6f5656", - "blendedVsPinnedBaseline": 0.4106818605605101 + "blendedVsPinnedBaseline": 0.9048406046474513 }, "series": [ { @@ -4032,42 +3752,264 @@ }, { "periodStart": "2026-04-20", - "recordedAt": "2026-04-20T12:22:33.984Z", - "blendedVsCurrentCohort": 0.38947254094340006, - "blendedVsPinnedBaseline": 0.4106818605605101, - "repoScore": 73.10000000000001, - "findingCount": 18 + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 0.7435310633443125, + "blendedVsPinnedBaseline": 0.9048406046474513, + "repoScore": 71.60000000000001, + "findingCount": 17 } ], "deltaFromFirst": { - "blendedVsCurrentCohort": -0.0038355769815410223, - "blendedVsPinnedBaseline": 0, - "repoScore": 0, - "findingCount": 0, + "blendedVsCurrentCohort": 0.35022294541937143, + "blendedVsPinnedBaseline": 0.4941587440869412, + "repoScore": -1.5, + "findingCount": -1, "fileCount": 0, "logicalLineCount": 0, "functionCount": 0, - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": 0 + "scorePerFile": -0.013274336283185861, + "scorePerKloc": -0.023050326546292688, + "scorePerFunction": -0.00028016436309301514, + "findingsPerFile": -0.00884955752212388, + "findingsPerKloc": -0.015366884364195144, + "findingsPerFunction": -0.0001867762420620098 }, "deltaFromPrevious": { - "blendedVsCurrentCohort": -0.0055439617035812905, - "blendedVsPinnedBaseline": 0, - "repoScore": 0, - "findingCount": 0, + "blendedVsCurrentCohort": 0.34851456069733117, + "blendedVsPinnedBaseline": 0.4941587440869412, + "repoScore": -1.5, + "findingCount": -1, "fileCount": 0, "logicalLineCount": 0, "functionCount": 0, - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": 0 + "scorePerFile": -0.013274336283185861, + "scorePerKloc": -0.023050326546292688, + "scorePerFunction": -0.00028016436309301514, + "findingsPerFile": -0.00884955752212388, + "findingsPerKloc": -0.015366884364195144, + "findingsPerFunction": -0.0001867762420620098 + } + }, + { + "id": "umami", + "repo": "umami-software/umami", + "cohort": "mature-oss", + "pointCount": 5, + "firstRecordedAt": "2026-03-23T12:00:00Z", + "latestRecordedAt": "2026-04-26T18:00:48.765Z", + "first": { + "schemaVersion": 1, + "benchmarkSetId": "known-ai-vs-solid-oss", + "benchmarkSetName": "Known AI repos vs older solid OSS repos", + "recordedAt": "2026-03-23T12:00:00Z", + "periodStart": "2026-03-23", + "repoId": "umami", + "repo": "umami-software/umami", + "cohort": "mature-oss", + "scanMode": "default-branch-as-of-recorded-at", + "defaultBranch": "master", + "ref": "60376624db2159acefd91e13bb9498770464c37c", + "analyzerVersion": "0.3.0", + "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", + "summary": { + "fileCount": 832, + "directoryCount": 196, + "findingCount": 59, + "repoScore": 151.86856060606064, + "physicalLineCount": 50570, + "logicalLineCount": 32880, + "functionCount": 1556, + "normalized": { + "scorePerFile": 0.1825343276515152, + "scorePerKloc": 4.618873497751236, + "scorePerFunction": 0.0976019027031238, + "findingsPerFile": 0.07091346153846154, + "findingsPerKloc": 1.7944038929440387, + "findingsPerFunction": 0.037917737789203085 + } + }, + "blended": { + "vsCurrentCohort": 1, + "vsPinnedBaseline": 1.0441733639448667 + }, + "ruleCounts": { + "structure.duplicate-function-signatures": 23, + "structure.directory-fanout-hotspot": 11, + "defensive.error-obscuring": 9, + "structure.pass-through-wrappers": 6, + "structure.barrel-density": 5, + "defensive.empty-catch": 3, + "defensive.error-swallowing": 1, + "structure.over-fragmentation": 1 + } + }, + "previous": { + "schemaVersion": 1, + "benchmarkSetId": "known-ai-vs-solid-oss", + "benchmarkSetName": "Known AI repos vs older solid OSS repos", + "recordedAt": "2026-04-13T12:00:00Z", + "periodStart": "2026-04-13", + "repoId": "umami", + "repo": "umami-software/umami", + "cohort": "mature-oss", + "scanMode": "default-branch-as-of-recorded-at", + "defaultBranch": "master", + "ref": "3a31ad35b04b86651a39481bba62b83eda2a2204", + "analyzerVersion": "0.3.0", + "analyzerCommit": "c64455e21d379cfda17f99b37ad7d1160763bef7", + "summary": { + "fileCount": 833, + "directoryCount": 195, + "findingCount": 59, + "repoScore": 151.86856060606064, + "physicalLineCount": 51206, + "logicalLineCount": 33079, + "functionCount": 1565, + "normalized": { + "scorePerFile": 0.18231519880679548, + "scorePerKloc": 4.591086810546288, + "scorePerFunction": 0.09704061380578954, + "findingsPerFile": 0.07082833133253301, + "findingsPerKloc": 1.783608936183077, + "findingsPerFunction": 0.03769968051118211 + } + }, + "blended": { + "vsCurrentCohort": 1, + "vsPinnedBaseline": 1.0396574771143894 + }, + "ruleCounts": { + "structure.duplicate-function-signatures": 23, + "structure.directory-fanout-hotspot": 11, + "defensive.error-obscuring": 9, + "structure.pass-through-wrappers": 6, + "structure.barrel-density": 5, + "defensive.empty-catch": 3, + "defensive.error-swallowing": 1, + "structure.over-fragmentation": 1 + } + }, + "latest": { + "schemaVersion": 1, + "benchmarkSetId": "known-ai-vs-solid-oss", + "benchmarkSetName": "Known AI repos vs older solid OSS repos", + "recordedAt": "2026-04-26T18:00:48.765Z", + "periodStart": "2026-04-20", + "repoId": "umami", + "repo": "umami-software/umami", + "cohort": "mature-oss", + "scanMode": "default-branch-as-of-recorded-at", + "defaultBranch": "master", + "ref": "c78ff36db0c82e13c86e5073020472c6546313a3", + "analyzerVersion": "0.3.0", + "analyzerCommit": "326869c100e1e999f1676c47f6a9e8a2327cca97", + "summary": { + "fileCount": 834, + "directoryCount": 195, + "findingCount": 20, + "repoScore": 57.20000000000001, + "physicalLineCount": 51283, + "logicalLineCount": 33141, + "functionCount": 1564, + "normalized": { + "scorePerFile": 0.06858513189448442, + "scorePerKloc": 1.7259587821731395, + "scorePerFunction": 0.036572890025575455, + "findingsPerFile": 0.023980815347721823, + "findingsPerKloc": 0.6034820916689297, + "findingsPerFunction": 0.01278772378516624 + } + }, + "blended": { + "vsCurrentCohort": 0.6987127752844935, + "vsPinnedBaseline": 0.8502989602339606 + }, + "ruleCounts": { + "defensive.error-obscuring": 9, + "structure.pass-through-wrappers": 6, + "defensive.empty-catch": 3, + "defensive.error-swallowing": 1, + "defensive.promise-default-fallbacks": 1 + } + }, + "highest": { + "periodStart": "2026-03-23", + "recordedAt": "2026-03-23T12:00:00Z", + "defaultBranch": "master", + "ref": "60376624db2159acefd91e13bb9498770464c37c", + "blendedVsPinnedBaseline": 1.0441733639448667 + }, + "series": [ + { + "periodStart": "2026-03-23", + "recordedAt": "2026-03-23T12:00:00Z", + "blendedVsCurrentCohort": 1, + "blendedVsPinnedBaseline": 1.0441733639448667, + "repoScore": 151.86856060606064, + "findingCount": 59 + }, + { + "periodStart": "2026-03-30", + "recordedAt": "2026-03-30T12:00:00Z", + "blendedVsCurrentCohort": 1, + "blendedVsPinnedBaseline": 1.0390728795873785, + "repoScore": 151.86856060606064, + "findingCount": 59 + }, + { + "periodStart": "2026-04-06", + "recordedAt": "2026-04-06T12:00:00Z", + "blendedVsCurrentCohort": 1, + "blendedVsPinnedBaseline": 1.0388216682437506, + "repoScore": 151.86856060606064, + "findingCount": 59 + }, + { + "periodStart": "2026-04-13", + "recordedAt": "2026-04-13T12:00:00Z", + "blendedVsCurrentCohort": 1, + "blendedVsPinnedBaseline": 1.0396574771143894, + "repoScore": 151.86856060606064, + "findingCount": 59 + }, + { + "periodStart": "2026-04-20", + "recordedAt": "2026-04-26T18:00:48.765Z", + "blendedVsCurrentCohort": 0.6987127752844935, + "blendedVsPinnedBaseline": 0.8502989602339606, + "repoScore": 57.20000000000001, + "findingCount": 20 + } + ], + "deltaFromFirst": { + "blendedVsCurrentCohort": -0.3012872247155065, + "blendedVsPinnedBaseline": -0.19387440371090614, + "repoScore": -94.66856060606062, + "findingCount": -39, + "fileCount": 2, + "logicalLineCount": 261, + "functionCount": 8, + "scorePerFile": -0.11394919575703077, + "scorePerKloc": -2.892914715578096, + "scorePerFunction": -0.061029012677548344, + "findingsPerFile": -0.04693264619073971, + "findingsPerKloc": -1.1909218012751088, + "findingsPerFunction": -0.025130014004036846 + }, + "deltaFromPrevious": { + "blendedVsCurrentCohort": -0.3012872247155065, + "blendedVsPinnedBaseline": -0.18935851688042882, + "repoScore": -94.66856060606062, + "findingCount": -39, + "fileCount": 1, + "logicalLineCount": 62, + "functionCount": -1, + "scorePerFile": -0.11373006691231105, + "scorePerKloc": -2.865128028373148, + "scorePerFunction": -0.06046772378021409, + "findingsPerFile": -0.04684751598481118, + "findingsPerKloc": -1.180126844514147, + "findingsPerFunction": -0.02491195672601587 } } ] diff --git a/benchmarks/history/known-ai-vs-solid-oss/node-notifier.jsonl b/benchmarks/history/known-ai-vs-solid-oss/node-notifier.jsonl index 31434d2..ac3e940 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/node-notifier.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/node-notifier.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"node-notifier","repo":"mikaelbr/node-notifier","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"b36c237f0d913f9df3a2bd45adc08b33ff717f6a","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":24,"directoryCount":5,"findingCount":1,"repoScore":1.9000000000000001,"physicalLineCount":2716,"logicalLineCount":2114,"functionCount":42,"normalized":{"scorePerFile":0.07916666666666668,"scorePerKloc":0.8987701040681174,"scorePerFunction":0.045238095238095244,"findingsPerFile":0.041666666666666664,"findingsPerKloc":0.4730368968779565,"findingsPerFunction":0.023809523809523808}},"blended":{"vsCurrentCohort":0.397048166366385,"vsPinnedBaseline":0.41256198156120816},"ruleCounts":{"defensive.empty-catch":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"node-notifier","repo":"mikaelbr/node-notifier","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"b36c237f0d913f9df3a2bd45adc08b33ff717f6a","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":24,"directoryCount":5,"findingCount":1,"repoScore":1.9000000000000001,"physicalLineCount":2716,"logicalLineCount":2114,"functionCount":42,"normalized":{"scorePerFile":0.07916666666666668,"scorePerKloc":0.8987701040681174,"scorePerFunction":0.045238095238095244,"findingsPerFile":0.041666666666666664,"findingsPerKloc":0.4730368968779565,"findingsPerFunction":0.023809523809523808}},"blended":{"vsCurrentCohort":0.3971441818870534,"vsPinnedBaseline":0.41256198156120816},"ruleCounts":{"defensive.empty-catch":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"node-notifier","repo":"mikaelbr/node-notifier","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"b36c237f0d913f9df3a2bd45adc08b33ff717f6a","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":24,"directoryCount":5,"findingCount":1,"repoScore":1.9000000000000001,"physicalLineCount":2716,"logicalLineCount":2114,"functionCount":42,"normalized":{"scorePerFile":0.07916666666666668,"scorePerKloc":0.8987701040681174,"scorePerFunction":0.045238095238095244,"findingsPerFile":0.041666666666666664,"findingsPerKloc":0.4730368968779565,"findingsPerFunction":0.023809523809523808}},"blended":{"vsCurrentCohort":0.39682490689750083,"vsPinnedBaseline":0.41256198156120816},"ruleCounts":{"defensive.empty-catch":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"node-notifier","repo":"mikaelbr/node-notifier","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"b36c237f0d913f9df3a2bd45adc08b33ff717f6a","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":24,"directoryCount":5,"findingCount":1,"repoScore":1.9000000000000001,"physicalLineCount":2716,"logicalLineCount":2114,"functionCount":42,"normalized":{"scorePerFile":0.07916666666666668,"scorePerKloc":0.8987701040681174,"scorePerFunction":0.045238095238095244,"findingsPerFile":0.041666666666666664,"findingsPerKloc":0.4730368968779565,"findingsPerFunction":0.023809523809523808}},"blended":{"vsCurrentCohort":0.3912555646747709,"vsPinnedBaseline":0.41256198156120816},"ruleCounts":{"defensive.empty-catch":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"node-notifier","repo":"mikaelbr/node-notifier","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"b36c237f0d913f9df3a2bd45adc08b33ff717f6a","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":24,"directoryCount":5,"findingCount":1,"repoScore":1.9000000000000001,"physicalLineCount":2716,"logicalLineCount":2114,"functionCount":42,"normalized":{"scorePerFile":0.07916666666666668,"scorePerKloc":0.8987701040681174,"scorePerFunction":0.045238095238095244,"findingsPerFile":0.041666666666666664,"findingsPerKloc":0.4730368968779565,"findingsPerFunction":0.023809523809523808}},"blended":{"vsCurrentCohort":0.7765988979179349,"vsPinnedBaseline":0.9450825271508594},"ruleCounts":{"defensive.empty-catch":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/openclaw.jsonl b/benchmarks/history/known-ai-vs-solid-oss/openclaw.jsonl index f9feba8..88d4bda 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/openclaw.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/openclaw.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"openclaw","repo":"openclaw/openclaw","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"bc3b05dce4b2ecd3534d6f233c9a00ad37afb9ae","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":8678,"directoryCount":379,"findingCount":2645,"repoScore":8799.451719426226,"physicalLineCount":1620383,"logicalLineCount":848724,"functionCount":34425,"normalized":{"scorePerFile":1.013995358311388,"scorePerKloc":10.36786012817621,"scorePerFunction":0.25561225038275165,"findingsPerFile":0.3047937312744872,"findingsPerKloc":3.1164430368411873,"findingsPerFunction":0.07683369644153958}},"blended":{"vsCurrentCohort":2.825371225507389,"vsPinnedBaseline":2.9357666151912833},"ruleCounts":{"tests.duplicate-mock-setup":727,"structure.pass-through-wrappers":495,"defensive.error-obscuring":322,"defensive.empty-catch":293,"structure.barrel-density":265,"defensive.async-noise":256,"structure.duplicate-function-signatures":198,"structure.directory-fanout-hotspot":53,"structure.over-fragmentation":20,"defensive.error-swallowing":16}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"openclaw","repo":"openclaw/openclaw","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"88aa81422653bc123de17550d62e2c4e5ced74fe","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":10219,"directoryCount":418,"findingCount":3356,"repoScore":11102.586696659166,"physicalLineCount":1915036,"logicalLineCount":1011052,"functionCount":40252,"normalized":{"scorePerFile":1.0864650843193233,"scorePerKloc":10.981222228588802,"scorePerFunction":0.2758269575837018,"findingsPerFile":0.32840786769742636,"findingsPerKloc":3.319314931378406,"findingsPerFunction":0.0833747391433966}},"blended":{"vsCurrentCohort":3.031981309889982,"vsPinnedBaseline":3.149687882423783},"ruleCounts":{"tests.duplicate-mock-setup":910,"structure.pass-through-wrappers":615,"structure.barrel-density":402,"defensive.error-obscuring":378,"structure.duplicate-function-signatures":318,"defensive.empty-catch":316,"defensive.async-noise":312,"structure.directory-fanout-hotspot":65,"structure.over-fragmentation":24,"defensive.error-swallowing":16}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"openclaw","repo":"openclaw/openclaw","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"1de5610b24dd7642b6412acd4a3035802038f909","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":11367,"directoryCount":437,"findingCount":3488,"repoScore":11255.99708285282,"physicalLineCount":2128022,"logicalLineCount":1119734,"functionCount":44237,"normalized":{"scorePerFile":0.9902346338394317,"scorePerKloc":10.052384836803045,"scorePerFunction":0.25444756838964716,"findingsPerFile":0.30685317146124746,"findingsPerKloc":3.1150255328497662,"findingsPerFunction":0.0788480231480435}},"blended":{"vsCurrentCohort":2.8110941249865755,"vsPinnedBaseline":2.9225750259146253},"ruleCounts":{"tests.duplicate-mock-setup":976,"structure.pass-through-wrappers":677,"structure.barrel-density":414,"defensive.error-obscuring":408,"defensive.async-noise":335,"defensive.empty-catch":333,"structure.duplicate-function-signatures":230,"structure.directory-fanout-hotspot":76,"structure.over-fragmentation":24,"defensive.error-swallowing":15}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"openclaw","repo":"openclaw/openclaw","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"d2b67fbb681a4219c5ed3d9653b9180caaf874f8","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":11826,"directoryCount":448,"findingCount":4539,"repoScore":15223.222299974419,"physicalLineCount":2247802,"logicalLineCount":1170720,"functionCount":46760,"normalized":{"scorePerFile":1.287267233212787,"scorePerKloc":13.003299080885625,"scorePerFunction":0.32556078485830664,"findingsPerFile":0.38381532217148656,"findingsPerKloc":3.87710127101271,"findingsPerFunction":0.09707014542343884}},"blended":{"vsCurrentCohort":3.5098116648847677,"vsPinnedBaseline":3.700943797630476},"ruleCounts":{"tests.duplicate-mock-setup":1001,"structure.pass-through-wrappers":695,"structure.barrel-density":433,"defensive.error-obscuring":424,"defensive.promise-default-fallbacks":374,"api.generic-status-envelopes":365,"defensive.async-noise":342,"defensive.empty-catch":342,"structure.duplicate-function-signatures":253,"types.generic-record-casts":131,"structure.directory-fanout-hotspot":78,"defensive.stringified-unknown-errors":62,"structure.over-fragmentation":24,"defensive.error-swallowing":15}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"openclaw","repo":"openclaw/openclaw","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"6b6dcafcee9ca86385b7c1ee2442752314d50257","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":13468,"directoryCount":500,"findingCount":3788,"repoScore":13474.59999999997,"physicalLineCount":2587247,"logicalLineCount":1327902,"functionCount":53442,"normalized":{"scorePerFile":1.0004900504900482,"scorePerKloc":10.14728496530615,"scorePerFunction":0.25213502488679257,"findingsPerFile":0.28125928125928124,"findingsPerKloc":2.852620148173585,"findingsPerFunction":0.0708805808165862}},"blended":{"vsCurrentCohort":5.258406087506312,"vsPinnedBaseline":6.399220662415981},"ruleCounts":{"tests.duplicate-mock-setup":1054,"structure.pass-through-wrappers":805,"defensive.error-obscuring":492,"defensive.promise-default-fallbacks":404,"api.generic-status-envelopes":399,"defensive.empty-catch":358,"types.generic-record-casts":151,"defensive.stringified-unknown-errors":107,"defensive.error-swallowing":18}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/openusage.jsonl b/benchmarks/history/known-ai-vs-solid-oss/openusage.jsonl index 85433fa..92ecb29 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/openusage.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/openusage.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"openusage","repo":"robinebers/openusage","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"4e152f7719f29a0e1936eb058df770138b306338","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":139,"directoryCount":29,"findingCount":46,"repoScore":176.3111111111111,"physicalLineCount":33440,"logicalLineCount":22244,"functionCount":487,"normalized":{"scorePerFile":1.2684252597921661,"scorePerKloc":7.926232292353493,"scorePerFunction":0.36203513575176816,"findingsPerFile":0.33093525179856115,"findingsPerKloc":2.06797338608164,"findingsPerFunction":0.0944558521560575}},"blended":{"vsCurrentCohort":2.9124251564230508,"vsPinnedBaseline":3.0262219938672197},"ruleCounts":{"tests.duplicate-mock-setup":25,"structure.duplicate-function-signatures":5,"structure.pass-through-wrappers":5,"defensive.empty-catch":4,"defensive.error-swallowing":3,"defensive.error-obscuring":2,"structure.directory-fanout-hotspot":2}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"openusage","repo":"robinebers/openusage","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"2c278068cdbfbd03937e232428271bc68208d778","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":139,"directoryCount":29,"findingCount":46,"repoScore":176.3111111111111,"physicalLineCount":33794,"logicalLineCount":22270,"functionCount":491,"normalized":{"scorePerFile":1.2684252597921661,"scorePerKloc":7.9169784962330985,"scorePerFunction":0.3590857660104096,"findingsPerFile":0.33093525179856115,"findingsPerKloc":2.0655590480466994,"findingsPerFunction":0.09368635437881874}},"blended":{"vsCurrentCohort":2.9040660942565824,"vsPinnedBaseline":3.016806784725735},"ruleCounts":{"tests.duplicate-mock-setup":25,"structure.duplicate-function-signatures":5,"structure.pass-through-wrappers":5,"defensive.empty-catch":4,"defensive.error-swallowing":3,"defensive.error-obscuring":2,"structure.directory-fanout-hotspot":2}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"openusage","repo":"robinebers/openusage","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"06113d6b94c6f8306e67aedf51b42f3f03d8b3e5","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":143,"directoryCount":31,"findingCount":50,"repoScore":195.3111111111111,"physicalLineCount":36980,"logicalLineCount":24758,"functionCount":562,"normalized":{"scorePerFile":1.3658119658119658,"scorePerKloc":7.8888081069194245,"scorePerFunction":0.34752866745749306,"findingsPerFile":0.34965034965034963,"findingsPerKloc":2.0195492366103887,"findingsPerFunction":0.08896797153024912}},"blended":{"vsCurrentCohort":2.9106934453164324,"vsPinnedBaseline":3.0261242040110723},"ruleCounts":{"tests.duplicate-mock-setup":28,"structure.duplicate-function-signatures":5,"structure.pass-through-wrappers":5,"defensive.empty-catch":4,"defensive.error-obscuring":3,"defensive.error-swallowing":3,"structure.directory-fanout-hotspot":2}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"openusage","repo":"robinebers/openusage","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"584d44d3910e16780ef2c206399ad0de5d596404","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":143,"directoryCount":31,"findingCount":52,"repoScore":207.3111111111111,"physicalLineCount":37446,"logicalLineCount":25153,"functionCount":566,"normalized":{"scorePerFile":1.4497280497280496,"scorePerKloc":8.24200338373598,"scorePerFunction":0.3662740478994896,"findingsPerFile":0.36363636363636365,"findingsPerKloc":2.067347831272612,"findingsPerFunction":0.09187279151943463}},"blended":{"vsCurrentCohort":2.9922952299177115,"vsPinnedBaseline":3.155245218038443},"ruleCounts":{"tests.duplicate-mock-setup":28,"structure.duplicate-function-signatures":5,"structure.pass-through-wrappers":5,"defensive.empty-catch":4,"defensive.error-obscuring":3,"defensive.error-swallowing":3,"structure.directory-fanout-hotspot":2,"api.generic-status-envelopes":1,"defensive.promise-default-fallbacks":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"openusage","repo":"robinebers/openusage","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"584d44d3910e16780ef2c206399ad0de5d596404","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":143,"directoryCount":31,"findingCount":45,"repoScore":188.7,"physicalLineCount":37446,"logicalLineCount":25153,"functionCount":566,"normalized":{"scorePerFile":1.3195804195804195,"scorePerKloc":7.502087226175804,"scorePerFunction":0.33339222614840985,"findingsPerFile":0.3146853146853147,"findingsPerKloc":1.7890510078320678,"findingsPerFunction":0.07950530035335689}},"blended":{"vsCurrentCohort":5.271326639649764,"vsPinnedBaseline":6.4149443366378405},"ruleCounts":{"tests.duplicate-mock-setup":28,"structure.pass-through-wrappers":5,"defensive.empty-catch":4,"defensive.error-obscuring":3,"defensive.error-swallowing":3,"api.generic-status-envelopes":1,"defensive.promise-default-fallbacks":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/payload.jsonl b/benchmarks/history/known-ai-vs-solid-oss/payload.jsonl index 9295a30..a7a74ec 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/payload.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/payload.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"payload","repo":"payloadcms/payload","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"727d74eff1476bcd8236f716282275e42f8786ad","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":6202,"directoryCount":2572,"findingCount":504,"repoScore":1485.9218101343095,"physicalLineCount":745564,"logicalLineCount":465034,"functionCount":5521,"normalized":{"scorePerFile":0.23958752178882772,"scorePerKloc":3.1952971398528054,"scorePerFunction":0.269139976477868,"findingsPerFile":0.08126410835214447,"findingsPerKloc":1.0837917227557554,"findingsPerFunction":0.09128781017931534}},"blended":{"vsCurrentCohort":1.2750388200492768,"vsPinnedBaseline":1.3248582583342952},"ruleCounts":{"structure.duplicate-function-signatures":177,"structure.directory-fanout-hotspot":97,"structure.barrel-density":66,"defensive.empty-catch":40,"defensive.error-obscuring":39,"defensive.error-swallowing":35,"structure.pass-through-wrappers":20,"structure.over-fragmentation":12,"tests.duplicate-mock-setup":10,"defensive.async-noise":7,"comments.placeholder-comments":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"payload","repo":"payloadcms/payload","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"2011f28233b38494cdbc1ec3e2eab81386725e20","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":6225,"directoryCount":2577,"findingCount":506,"repoScore":1495.1690323565317,"physicalLineCount":749749,"logicalLineCount":466942,"functionCount":5540,"normalized":{"scorePerFile":0.24018779636249504,"scorePerKloc":3.2020444345476133,"scorePerFunction":0.2698861069235617,"findingsPerFile":0.08128514056224899,"findingsPerKloc":1.0836463629315847,"findingsPerFunction":0.09133574007220216}},"blended":{"vsCurrentCohort":1.2770550762355934,"vsPinnedBaseline":1.3266324847342088},"ruleCounts":{"structure.duplicate-function-signatures":177,"structure.directory-fanout-hotspot":97,"structure.barrel-density":66,"defensive.empty-catch":41,"defensive.error-obscuring":39,"defensive.error-swallowing":35,"structure.pass-through-wrappers":20,"structure.over-fragmentation":13,"tests.duplicate-mock-setup":10,"defensive.async-noise":7,"comments.placeholder-comments":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"payload","repo":"payloadcms/payload","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"5afcef5d85d596b0536d02e10bb3e7d254d48bc8","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":6250,"directoryCount":2578,"findingCount":513,"repoScore":1525.0410561660556,"physicalLineCount":754256,"logicalLineCount":469447,"functionCount":5558,"normalized":{"scorePerFile":0.2440065689865689,"scorePerKloc":3.2485904823463683,"scorePerFunction":0.274386659979499,"findingsPerFile":0.08208,"findingsPerKloc":1.092775116253805,"findingsPerFunction":0.09229938826916156}},"blended":{"vsCurrentCohort":1.2921562583044328,"vsPinnedBaseline":1.3433999155463558},"ruleCounts":{"structure.duplicate-function-signatures":177,"structure.directory-fanout-hotspot":102,"structure.barrel-density":66,"defensive.empty-catch":42,"defensive.error-obscuring":40,"defensive.error-swallowing":35,"structure.pass-through-wrappers":20,"structure.over-fragmentation":13,"tests.duplicate-mock-setup":10,"defensive.async-noise":7,"comments.placeholder-comments":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"payload","repo":"payloadcms/payload","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"48db8c199fe9aeb9f88d32daac40b7727c4a5ca8","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":6310,"directoryCount":2592,"findingCount":563,"repoScore":1705.804487179487,"physicalLineCount":764044,"logicalLineCount":473553,"functionCount":5618,"normalized":{"scorePerFile":0.2703335161932626,"scorePerKloc":3.6021405992137883,"scorePerFunction":0.3036319841900119,"findingsPerFile":0.08922345483359746,"findingsPerKloc":1.1888848766663922,"findingsPerFunction":0.10021359914560342}},"blended":{"vsCurrentCohort":1.3979699200225955,"vsPinnedBaseline":1.4740984983738326},"ruleCounts":{"structure.duplicate-function-signatures":184,"structure.directory-fanout-hotspot":103,"structure.barrel-density":67,"defensive.empty-catch":44,"defensive.error-obscuring":41,"defensive.error-swallowing":35,"structure.pass-through-wrappers":20,"api.generic-status-envelopes":16,"structure.over-fragmentation":13,"tests.duplicate-mock-setup":13,"defensive.promise-default-fallbacks":10,"defensive.stringified-unknown-errors":9,"defensive.async-noise":7,"comments.placeholder-comments":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"payload","repo":"payloadcms/payload","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"0ceba0206fa838d66412640ad976e2572a97c768","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":6125,"directoryCount":2500,"findingCount":189,"repoScore":629.6999999999998,"physicalLineCount":754798,"logicalLineCount":467009,"functionCount":5470,"normalized":{"scorePerFile":0.10280816326530609,"scorePerKloc":1.3483680186034954,"scorePerFunction":0.11511882998171843,"findingsPerFile":0.030857142857142857,"findingsPerKloc":0.40470312135312164,"findingsPerFunction":0.034552102376599635}},"blended":{"vsCurrentCohort":1,"vsPinnedBaseline":1.2169506416821216},"ruleCounts":{"defensive.empty-catch":44,"defensive.error-obscuring":41,"defensive.error-swallowing":35,"structure.pass-through-wrappers":20,"api.generic-status-envelopes":16,"tests.duplicate-mock-setup":13,"defensive.promise-default-fallbacks":11,"defensive.stringified-unknown-errors":9}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/tsup.jsonl b/benchmarks/history/known-ai-vs-solid-oss/tsup.jsonl index 417e4ed..ab43bbe 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/tsup.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/tsup.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"tsup","repo":"egoist/tsup","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"b906f86102c02f1ef66ebd4a3f7ff50bdc07af65","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":48,"directoryCount":8,"findingCount":4,"repoScore":10.142857142857142,"physicalLineCount":6686,"logicalLineCount":2813,"functionCount":140,"normalized":{"scorePerFile":0.2113095238095238,"scorePerKloc":3.605708191559595,"scorePerFunction":0.07244897959183673,"findingsPerFile":0.08333333333333333,"findingsPerKloc":1.4219694276573054,"findingsPerFunction":0.02857142857142857}},"blended":{"vsCurrentCohort":0.8863094520808851,"vsPinnedBaseline":0.9209401145791967},"ruleCounts":{"structure.pass-through-wrappers":2,"defensive.error-obscuring":1,"structure.directory-fanout-hotspot":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"tsup","repo":"egoist/tsup","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"b906f86102c02f1ef66ebd4a3f7ff50bdc07af65","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":48,"directoryCount":8,"findingCount":4,"repoScore":10.142857142857142,"physicalLineCount":6686,"logicalLineCount":2813,"functionCount":140,"normalized":{"scorePerFile":0.2113095238095238,"scorePerKloc":3.605708191559595,"scorePerFunction":0.07244897959183673,"findingsPerFile":0.08333333333333333,"findingsPerKloc":1.4219694276573054,"findingsPerFunction":0.02857142857142857}},"blended":{"vsCurrentCohort":0.8865237824083452,"vsPinnedBaseline":0.9209401145791967},"ruleCounts":{"structure.pass-through-wrappers":2,"defensive.error-obscuring":1,"structure.directory-fanout-hotspot":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"tsup","repo":"egoist/tsup","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"b906f86102c02f1ef66ebd4a3f7ff50bdc07af65","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":48,"directoryCount":8,"findingCount":4,"repoScore":10.142857142857142,"physicalLineCount":6686,"logicalLineCount":2813,"functionCount":140,"normalized":{"scorePerFile":0.2113095238095238,"scorePerKloc":3.605708191559595,"scorePerFunction":0.07244897959183673,"findingsPerFile":0.08333333333333333,"findingsPerKloc":1.4219694276573054,"findingsPerFunction":0.02857142857142857}},"blended":{"vsCurrentCohort":0.8858110818721784,"vsPinnedBaseline":0.9209401145791967},"ruleCounts":{"structure.pass-through-wrappers":2,"defensive.error-obscuring":1,"structure.directory-fanout-hotspot":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"tsup","repo":"egoist/tsup","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"b906f86102c02f1ef66ebd4a3f7ff50bdc07af65","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":48,"directoryCount":8,"findingCount":4,"repoScore":10.142857142857142,"physicalLineCount":6686,"logicalLineCount":2813,"functionCount":140,"normalized":{"scorePerFile":0.2113095238095238,"scorePerKloc":3.605708191559595,"scorePerFunction":0.07244897959183673,"findingsPerFile":0.08333333333333333,"findingsPerKloc":1.4219694276573054,"findingsPerFunction":0.02857142857142857}},"blended":{"vsCurrentCohort":0.8733789361729491,"vsPinnedBaseline":0.9209401145791967},"ruleCounts":{"structure.pass-through-wrappers":2,"defensive.error-obscuring":1,"structure.directory-fanout-hotspot":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"tsup","repo":"egoist/tsup","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"b906f86102c02f1ef66ebd4a3f7ff50bdc07af65","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":48,"directoryCount":8,"findingCount":3,"repoScore":7,"physicalLineCount":6686,"logicalLineCount":2813,"functionCount":140,"normalized":{"scorePerFile":0.14583333333333334,"scorePerKloc":2.4884464984002843,"scorePerFunction":0.05,"findingsPerFile":0.0625,"findingsPerKloc":1.066477070742979,"findingsPerFunction":0.02142857142857143}},"blended":{"vsCurrentCohort":1.2472067522365113,"vsPinnedBaseline":1.5177890574444977},"ruleCounts":{"structure.pass-through-wrappers":2,"defensive.error-obscuring":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/umami.jsonl b/benchmarks/history/known-ai-vs-solid-oss/umami.jsonl index d10a799..4b85bad 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/umami.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/umami.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"umami","repo":"umami-software/umami","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"3f673557a9575ef8926dbd030ff88f1838db850b","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":834,"directoryCount":196,"findingCount":59,"repoScore":151.86856060606064,"physicalLineCount":51201,"logicalLineCount":33074,"functionCount":1566,"normalized":{"scorePerFile":0.18209659545091203,"scorePerKloc":4.59178087337669,"scorePerFunction":0.09697864661945124,"findingsPerFile":0.07074340527577938,"findingsPerKloc":1.7838785753159583,"findingsPerFunction":0.037675606641123884}},"blended":{"vsCurrentCohort":1,"vsPinnedBaseline":1.0390728795873785},"ruleCounts":{"structure.duplicate-function-signatures":23,"structure.directory-fanout-hotspot":11,"defensive.error-obscuring":9,"structure.pass-through-wrappers":6,"structure.barrel-density":5,"defensive.empty-catch":3,"defensive.error-swallowing":1,"structure.over-fragmentation":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"umami","repo":"umami-software/umami","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"4ca7d53f817cf421dda2172eee1d5bc81fe2dbd7","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":834,"directoryCount":196,"findingCount":59,"repoScore":151.86856060606064,"physicalLineCount":51228,"logicalLineCount":33098,"functionCount":1566,"normalized":{"scorePerFile":0.18209659545091203,"scorePerKloc":4.588451284248615,"scorePerFunction":0.09697864661945124,"findingsPerFile":0.07074340527577938,"findingsPerKloc":1.782585050456221,"findingsPerFunction":0.037675606641123884}},"blended":{"vsCurrentCohort":1,"vsPinnedBaseline":1.0388216682437506},"ruleCounts":{"structure.duplicate-function-signatures":23,"structure.directory-fanout-hotspot":11,"defensive.error-obscuring":9,"structure.pass-through-wrappers":6,"structure.barrel-density":5,"defensive.empty-catch":3,"defensive.error-swallowing":1,"structure.over-fragmentation":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"umami","repo":"umami-software/umami","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"3a31ad35b04b86651a39481bba62b83eda2a2204","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":833,"directoryCount":195,"findingCount":59,"repoScore":151.86856060606064,"physicalLineCount":51206,"logicalLineCount":33079,"functionCount":1565,"normalized":{"scorePerFile":0.18231519880679548,"scorePerKloc":4.591086810546288,"scorePerFunction":0.09704061380578954,"findingsPerFile":0.07082833133253301,"findingsPerKloc":1.783608936183077,"findingsPerFunction":0.03769968051118211}},"blended":{"vsCurrentCohort":1,"vsPinnedBaseline":1.0396574771143894},"ruleCounts":{"structure.duplicate-function-signatures":23,"structure.directory-fanout-hotspot":11,"defensive.error-obscuring":9,"structure.pass-through-wrappers":6,"structure.barrel-density":5,"defensive.empty-catch":3,"defensive.error-swallowing":1,"structure.over-fragmentation":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"umami","repo":"umami-software/umami","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"c78ff36db0c82e13c86e5073020472c6546313a3","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":834,"directoryCount":195,"findingCount":60,"repoScore":153.8685606060606,"physicalLineCount":51283,"logicalLineCount":33141,"functionCount":1564,"normalized":{"scorePerFile":0.1844946769856842,"scorePerKloc":4.642846039831647,"scorePerFunction":0.09838143261257072,"findingsPerFile":0.07194244604316546,"findingsPerKloc":1.8104462750067893,"findingsPerFunction":0.03836317135549872}},"blended":{"vsCurrentCohort":1,"vsPinnedBaseline":1.0544565210315873},"ruleCounts":{"structure.duplicate-function-signatures":23,"structure.directory-fanout-hotspot":11,"defensive.error-obscuring":9,"structure.pass-through-wrappers":6,"structure.barrel-density":5,"defensive.empty-catch":3,"defensive.error-swallowing":1,"defensive.promise-default-fallbacks":1,"structure.over-fragmentation":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"umami","repo":"umami-software/umami","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"master","ref":"c78ff36db0c82e13c86e5073020472c6546313a3","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":834,"directoryCount":195,"findingCount":20,"repoScore":57.20000000000001,"physicalLineCount":51283,"logicalLineCount":33141,"functionCount":1564,"normalized":{"scorePerFile":0.06858513189448442,"scorePerKloc":1.7259587821731395,"scorePerFunction":0.036572890025575455,"findingsPerFile":0.023980815347721823,"findingsPerKloc":0.6034820916689297,"findingsPerFunction":0.01278772378516624}},"blended":{"vsCurrentCohort":0.6987127752844935,"vsPinnedBaseline":0.8502989602339606},"ruleCounts":{"defensive.error-obscuring":9,"structure.pass-through-wrappers":6,"defensive.empty-catch":3,"defensive.error-swallowing":1,"defensive.promise-default-fallbacks":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/vinext.jsonl b/benchmarks/history/known-ai-vs-solid-oss/vinext.jsonl index 4785b1b..069cb1c 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/vinext.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/vinext.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"vinext","repo":"cloudflare/vinext","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"a7dd2d56af100ea7c109834d65ec76a3dbcefe32","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1090,"directoryCount":470,"findingCount":159,"repoScore":518.3082251082251,"physicalLineCount":141379,"logicalLineCount":57114,"functionCount":2743,"normalized":{"scorePerFile":0.475512133126812,"scorePerKloc":9.074976802679293,"scorePerFunction":0.18895669890930553,"findingsPerFile":0.14587155963302753,"findingsPerKloc":2.783905872465595,"findingsPerFunction":0.057965730951512945}},"blended":{"vsCurrentCohort":1.918002714883301,"vsPinnedBaseline":1.9929446040102008},"ruleCounts":{"structure.duplicate-function-signatures":49,"structure.pass-through-wrappers":28,"defensive.error-obscuring":21,"tests.duplicate-mock-setup":17,"defensive.empty-catch":16,"structure.directory-fanout-hotspot":15,"defensive.async-noise":4,"defensive.error-swallowing":3,"structure.barrel-density":3,"structure.over-fragmentation":3}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"vinext","repo":"cloudflare/vinext","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"ccb299ab79cbd0749614fc48ce7e1ebcf8e183ae","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1129,"directoryCount":486,"findingCount":164,"repoScore":547.452724726254,"physicalLineCount":149555,"logicalLineCount":59877,"functionCount":2901,"normalized":{"scorePerFile":0.4849005533447777,"scorePerKloc":9.142955136801342,"scorePerFunction":0.18871172861987384,"findingsPerFile":0.14526129317980513,"findingsPerKloc":2.738948177096381,"findingsPerFunction":0.05653223026542571}},"blended":{"vsCurrentCohort":1.912146851658272,"vsPinnedBaseline":1.9863795823666808},"ruleCounts":{"structure.duplicate-function-signatures":50,"structure.pass-through-wrappers":29,"defensive.error-obscuring":24,"tests.duplicate-mock-setup":18,"defensive.empty-catch":16,"structure.directory-fanout-hotspot":15,"defensive.async-noise":4,"structure.barrel-density":3,"structure.over-fragmentation":3,"defensive.error-swallowing":2}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"vinext","repo":"cloudflare/vinext","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"e81a6212d5c8c4d3f1cad6186178204cf004db4e","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1174,"directoryCount":504,"findingCount":167,"repoScore":551.8886724386724,"physicalLineCount":155384,"logicalLineCount":62152,"functionCount":3060,"normalized":{"scorePerFile":0.4700925659613905,"scorePerKloc":8.87966070985121,"scorePerFunction":0.1803557753067557,"findingsPerFile":0.14224872231686542,"findingsPerKloc":2.6869609988415495,"findingsPerFunction":0.05457516339869281}},"blended":{"vsCurrentCohort":1.853871918339763,"vsPinnedBaseline":1.9273918015143312},"ruleCounts":{"structure.duplicate-function-signatures":50,"structure.pass-through-wrappers":29,"defensive.error-obscuring":25,"defensive.empty-catch":18,"tests.duplicate-mock-setup":18,"structure.directory-fanout-hotspot":15,"defensive.async-noise":4,"structure.barrel-density":3,"structure.over-fragmentation":3,"defensive.error-swallowing":2}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"vinext","repo":"cloudflare/vinext","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"bc03bf1c7138a2ca62b35ad163338d89ca3de145","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":1187,"directoryCount":506,"findingCount":221,"repoScore":711.805339105339,"physicalLineCount":159077,"logicalLineCount":63673,"functionCount":3170,"normalized":{"scorePerFile":0.5996675139893336,"scorePerKloc":11.17907651760305,"scorePerFunction":0.22454427101114796,"findingsPerFile":0.18618365627632688,"findingsPerKloc":3.470858919793319,"findingsPerFunction":0.06971608832807571}},"blended":{"vsCurrentCohort":2.332529928593622,"vsPinnedBaseline":2.459551393706888},"ruleCounts":{"structure.duplicate-function-signatures":50,"defensive.promise-default-fallbacks":32,"structure.pass-through-wrappers":29,"defensive.error-obscuring":26,"tests.duplicate-mock-setup":20,"defensive.empty-catch":18,"structure.directory-fanout-hotspot":15,"defensive.stringified-unknown-errors":11,"api.generic-status-envelopes":5,"defensive.async-noise":4,"structure.barrel-density":3,"structure.over-fragmentation":3,"defensive.error-swallowing":2,"types.generic-record-casts":2,"comments.placeholder-comments":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"vinext","repo":"cloudflare/vinext","cohort":"explicit-ai","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"67a929bf25727904f1896fe3626fd914be7228a4","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":1226,"directoryCount":530,"findingCount":149,"repoScore":487.7,"physicalLineCount":162437,"logicalLineCount":64952,"functionCount":3267,"normalized":{"scorePerFile":0.3977977161500816,"scorePerKloc":7.508621751447222,"scorePerFunction":0.149280685644322,"findingsPerFile":0.12153344208809136,"findingsPerKloc":2.2940017243502897,"findingsPerFunction":0.045607591062136514}},"blended":{"vsCurrentCohort":3.061497732405407,"vsPinnedBaseline":3.7256916299591216},"ruleCounts":{"defensive.promise-default-fallbacks":32,"defensive.error-obscuring":29,"structure.pass-through-wrappers":29,"tests.duplicate-mock-setup":20,"defensive.empty-catch":18,"defensive.stringified-unknown-errors":12,"api.generic-status-envelopes":5,"defensive.error-swallowing":2,"types.generic-record-casts":2}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/vite.jsonl b/benchmarks/history/known-ai-vs-solid-oss/vite.jsonl index fd3aa1c..ba577a2 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/vite.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/vite.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"vite","repo":"vitejs/vite","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"6daa10ff1e8d15a90f49d8dd909ff208da85d6d8","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1423,"directoryCount":615,"findingCount":115,"repoScore":380.64387822322607,"physicalLineCount":95066,"logicalLineCount":46280,"functionCount":2294,"normalized":{"scorePerFile":0.2674939411266522,"scorePerKloc":8.224802900242569,"scorePerFunction":0.16593019974857282,"findingsPerFile":0.08081517919887561,"findingsPerKloc":2.4848746758859117,"findingsPerFunction":0.05013077593722755}},"blended":{"vsCurrentCohort":1.456127340215348,"vsPinnedBaseline":1.5130224284434717},"ruleCounts":{"structure.pass-through-wrappers":27,"structure.directory-fanout-hotspot":21,"defensive.empty-catch":14,"structure.barrel-density":11,"defensive.error-obscuring":10,"defensive.async-noise":9,"structure.over-fragmentation":8,"defensive.error-swallowing":6,"tests.duplicate-mock-setup":6,"structure.duplicate-function-signatures":3}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"vite","repo":"vitejs/vite","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"79f002f2286c03c88c7b74c511c7f9fc6dc46694","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1432,"directoryCount":618,"findingCount":114,"repoScore":377.94093704675544,"physicalLineCount":95795,"logicalLineCount":46589,"functionCount":2299,"normalized":{"scorePerFile":0.26392523536784596,"scorePerKloc":8.112235442846067,"scorePerFunction":0.16439362202990668,"findingsPerFile":0.07960893854748603,"findingsPerKloc":2.4469295327223164,"findingsPerFunction":0.049586776859504134}},"blended":{"vsCurrentCohort":1.437702992014066,"vsPinnedBaseline":1.4935170206030834},"ruleCounts":{"structure.pass-through-wrappers":27,"structure.directory-fanout-hotspot":20,"defensive.empty-catch":14,"structure.barrel-density":11,"defensive.error-obscuring":10,"defensive.async-noise":9,"structure.over-fragmentation":8,"defensive.error-swallowing":6,"tests.duplicate-mock-setup":6,"structure.duplicate-function-signatures":3}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"vite","repo":"vitejs/vite","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"bc5c6a7a498845dff20dc410c395355b79a4b753","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":1438,"directoryCount":622,"findingCount":117,"repoScore":381.69093704675544,"physicalLineCount":96023,"logicalLineCount":46665,"functionCount":2307,"normalized":{"scorePerFile":0.2654318060130427,"scorePerKloc":8.179383628988653,"scorePerFunction":0.16544904076582376,"findingsPerFile":0.08136300417246176,"findingsPerKloc":2.507232401157184,"findingsPerFunction":0.05071521456436931}},"blended":{"vsCurrentCohort":1.4580090921548914,"vsPinnedBaseline":1.5158300543595955},"ruleCounts":{"structure.pass-through-wrappers":27,"structure.directory-fanout-hotspot":20,"defensive.empty-catch":14,"structure.barrel-density":11,"defensive.error-obscuring":10,"defensive.async-noise":9,"structure.over-fragmentation":8,"defensive.error-swallowing":6,"structure.duplicate-function-signatures":6,"tests.duplicate-mock-setup":6}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"vite","repo":"vitejs/vite","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"3770a53064e8da27d4cb8d595a2b038413e6abdb","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":1440,"directoryCount":623,"findingCount":125,"repoScore":399.5909370467554,"physicalLineCount":96101,"logicalLineCount":46751,"functionCount":2308,"normalized":{"scorePerFile":0.27749370628246905,"scorePerKloc":8.547216894756378,"scorePerFunction":0.17313298832181778,"findingsPerFile":0.08680555555555555,"findingsPerKloc":2.6737395991529596,"findingsPerFunction":0.05415944540727903}},"blended":{"vsCurrentCohort":1.5184668649766124,"vsPinnedBaseline":1.6011572877449798},"ruleCounts":{"structure.pass-through-wrappers":27,"structure.directory-fanout-hotspot":20,"defensive.empty-catch":15,"structure.barrel-density":11,"defensive.error-obscuring":10,"defensive.async-noise":9,"structure.over-fragmentation":8,"defensive.error-swallowing":6,"structure.duplicate-function-signatures":6,"tests.duplicate-mock-setup":6,"defensive.promise-default-fallbacks":4,"api.generic-status-envelopes":3}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"vite","repo":"vitejs/vite","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"640202a2167b0c19b94e4d3b8ff87309ae1f44d0","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":1442,"directoryCount":625,"findingCount":72,"repoScore":223.4,"physicalLineCount":96133,"logicalLineCount":46804,"functionCount":2307,"normalized":{"scorePerFile":0.1549237170596394,"scorePerKloc":4.773096316554141,"scorePerFunction":0.09683571738188124,"findingsPerFile":0.049930651872399444,"findingsPerKloc":1.538330057260063,"findingsPerFunction":0.031209362808842653}},"blended":{"vsCurrentCohort":1.709166473326745,"vsPinnedBaseline":2.0799712364565517},"ruleCounts":{"structure.pass-through-wrappers":27,"defensive.empty-catch":15,"defensive.error-obscuring":10,"defensive.error-swallowing":6,"tests.duplicate-mock-setup":6,"defensive.promise-default-fallbacks":4,"api.generic-status-envelopes":3,"defensive.stringified-unknown-errors":1}} diff --git a/benchmarks/history/known-ai-vs-solid-oss/zustand.jsonl b/benchmarks/history/known-ai-vs-solid-oss/zustand.jsonl index 6c4842b..097eb10 100644 --- a/benchmarks/history/known-ai-vs-solid-oss/zustand.jsonl +++ b/benchmarks/history/known-ai-vs-solid-oss/zustand.jsonl @@ -2,4 +2,4 @@ {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-03-30T12:00:00Z","periodStart":"2026-03-30","repoId":"zustand","repo":"pmndrs/zustand","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"206012dbd1ae046ea0aefb9cd7bf8bba913c6459","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":49,"directoryCount":15,"findingCount":9,"repoScore":22.866666666666667,"physicalLineCount":9464,"logicalLineCount":7606,"functionCount":171,"normalized":{"scorePerFile":0.4666666666666667,"scorePerKloc":3.006398457358226,"scorePerFunction":0.13372319688109163,"findingsPerFile":0.1836734693877551,"findingsPerKloc":1.183276360767815,"findingsPerFunction":0.05263157894736842}},"blended":{"vsCurrentCohort":1.3312554967387273,"vsPinnedBaseline":1.3832714824628354},"ruleCounts":{"structure.barrel-density":3,"structure.directory-fanout-hotspot":2,"defensive.empty-catch":1,"defensive.error-obscuring":1,"defensive.error-swallowing":1,"structure.pass-through-wrappers":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-06T12:00:00Z","periodStart":"2026-04-06","repoId":"zustand","repo":"pmndrs/zustand","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"00f96a389d4015ecf4eadb42aa1e4e0efe14bb95","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":49,"directoryCount":15,"findingCount":9,"repoScore":22.866666666666667,"physicalLineCount":9584,"logicalLineCount":7699,"functionCount":171,"normalized":{"scorePerFile":0.4666666666666667,"scorePerKloc":2.9700826947222585,"scorePerFunction":0.13372319688109163,"findingsPerFile":0.1836734693877551,"findingsPerKloc":1.1689829848032212,"findingsPerFunction":0.05263157894736842}},"blended":{"vsCurrentCohort":1.326194098484615,"vsPinnedBaseline":1.3776791658028045},"ruleCounts":{"structure.barrel-density":3,"structure.directory-fanout-hotspot":2,"defensive.empty-catch":1,"defensive.error-obscuring":1,"defensive.error-swallowing":1,"structure.pass-through-wrappers":1}} {"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-13T12:00:00Z","periodStart":"2026-04-13","repoId":"zustand","repo":"pmndrs/zustand","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"00f96a389d4015ecf4eadb42aa1e4e0efe14bb95","analyzerVersion":"0.3.0","analyzerCommit":"c64455e21d379cfda17f99b37ad7d1160763bef7","summary":{"fileCount":49,"directoryCount":15,"findingCount":9,"repoScore":22.866666666666667,"physicalLineCount":9584,"logicalLineCount":7699,"functionCount":171,"normalized":{"scorePerFile":0.4666666666666667,"scorePerKloc":2.9700826947222585,"scorePerFunction":0.13372319688109163,"findingsPerFile":0.1836734693877551,"findingsPerKloc":1.1689829848032212,"findingsPerFunction":0.05263157894736842}},"blended":{"vsCurrentCohort":1.3251279350451146,"vsPinnedBaseline":1.3776791658028045},"ruleCounts":{"structure.barrel-density":3,"structure.directory-fanout-hotspot":2,"defensive.empty-catch":1,"defensive.error-obscuring":1,"defensive.error-swallowing":1,"structure.pass-through-wrappers":1}} -{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-20T12:22:33.984Z","periodStart":"2026-04-20","repoId":"zustand","repo":"pmndrs/zustand","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"32013285083648e8d58ba1f76d73b9bdc02fef50","analyzerVersion":"0.3.0","analyzerCommit":"df9e2d480c43ab6a1556caff16ab313302926a2a","summary":{"fileCount":49,"directoryCount":15,"findingCount":9,"repoScore":22.866666666666667,"physicalLineCount":9584,"logicalLineCount":7699,"functionCount":171,"normalized":{"scorePerFile":0.4666666666666667,"scorePerKloc":2.9700826947222585,"scorePerFunction":0.13372319688109163,"findingsPerFile":0.1836734693877551,"findingsPerKloc":1.1689829848032212,"findingsPerFunction":0.05263157894736842}},"blended":{"vsCurrentCohort":1.3065300828667685,"vsPinnedBaseline":1.3776791658028045},"ruleCounts":{"structure.barrel-density":3,"structure.directory-fanout-hotspot":2,"defensive.empty-catch":1,"defensive.error-obscuring":1,"defensive.error-swallowing":1,"structure.pass-through-wrappers":1}} +{"schemaVersion":1,"benchmarkSetId":"known-ai-vs-solid-oss","benchmarkSetName":"Known AI repos vs older solid OSS repos","recordedAt":"2026-04-26T18:00:48.765Z","periodStart":"2026-04-20","repoId":"zustand","repo":"pmndrs/zustand","cohort":"mature-oss","scanMode":"default-branch-as-of-recorded-at","defaultBranch":"main","ref":"95d3f338c463f499aaa7a8dd5448c8b13a7dec0b","analyzerVersion":"0.3.0","analyzerCommit":"326869c100e1e999f1676c47f6a9e8a2327cca97","summary":{"fileCount":50,"directoryCount":15,"findingCount":4,"repoScore":9.7,"physicalLineCount":9659,"logicalLineCount":7761,"functionCount":171,"normalized":{"scorePerFile":0.19399999999999998,"scorePerKloc":1.2498389382811492,"scorePerFunction":0.05672514619883041,"findingsPerFile":0.08,"findingsPerKloc":0.5153975003221234,"findingsPerFunction":0.023391812865497075}},"blended":{"vsCurrentCohort":1.1154832958468233,"vsPinnedBaseline":1.3574881126664797},"ruleCounts":{"defensive.empty-catch":1,"defensive.error-obscuring":1,"defensive.error-swallowing":1,"structure.pass-through-wrappers":1}} diff --git a/benchmarks/results/known-ai-vs-solid-oss.json b/benchmarks/results/known-ai-vs-solid-oss.json index 17b187a..0b3792a 100644 --- a/benchmarks/results/known-ai-vs-solid-oss.json +++ b/benchmarks/results/known-ai-vs-solid-oss.json @@ -2,7 +2,7 @@ "schemaVersion": 1, "benchmarkSetId": "known-ai-vs-solid-oss", "benchmarkSetName": "Known AI repos vs older solid OSS repos", - "generatedAt": "2026-04-17T23:32:37.950Z", + "generatedAt": "2026-04-26T18:00:48.544Z", "analyzerVersion": "0.3.0", "configMode": "default", "repos": [ @@ -14,31 +14,36 @@ "summary": { "fileCount": 139, "directoryCount": 29, - "findingCount": 46, - "repoScore": 176.3111111111111, + "findingCount": 41, + "repoScore": 169.7, "physicalLineCount": 33794, "logicalLineCount": 22270, "functionCount": 491, "normalized": { - "scorePerFile": 1.2684252597921661, - "scorePerKloc": 7.9169784962330985, - "scorePerFunction": 0.3590857660104096, - "findingsPerFile": 0.33093525179856115, - "findingsPerKloc": 2.0655590480466994, - "findingsPerFunction": 0.09368635437881874 + "scorePerFile": 1.2208633093525179, + "scorePerKloc": 7.6201167489896715, + "scorePerFunction": 0.3456211812627291, + "findingsPerFile": 0.2949640287769784, + "findingsPerKloc": 1.8410417602155367, + "findingsPerFunction": 0.0835030549898167 } }, - "blendedScore": 3.016806784725735, + "blendedScore": 6.400915856451067, "ruleCounts": { "tests.duplicate-mock-setup": 25, - "structure.duplicate-function-signatures": 5, "structure.pass-through-wrappers": 5, "defensive.empty-catch": 4, "defensive.error-swallowing": 3, "defensive.error-obscuring": 2, - "structure.directory-fanout-hotspot": 2 + "api.generic-status-envelopes": 1, + "defensive.promise-default-fallbacks": 1 }, "topFiles": [ + { + "path": "plugins/opencode-go/plugin.js", + "score": 10, + "findingCount": 2 + }, { "path": "plugins/antigravity/plugin.js", "score": 9, @@ -49,34 +54,18 @@ "score": 8, "findingCount": 1 }, - { - "path": "plugins/codex/plugin.js", - "score": 5.75, - "findingCount": 2 - }, { "path": "plugins/factory/plugin.js", "score": 5.5, "findingCount": 2 }, { - "path": "plugins/gemini/plugin.js", - "score": 5.25, - "findingCount": 2 - } - ], - "topDirectories": [ - { - "path": "src/hooks/app", - "score": 4.083333333333334, - "findingCount": 1 - }, - { - "path": "src/lib", - "score": 3.2777777777777777, + "path": "plugins/amp/plugin.test.js", + "score": 5, "findingCount": 1 } - ] + ], + "topDirectories": [] }, { "id": "devworkbench", @@ -86,29 +75,39 @@ "summary": { "fileCount": 32, "directoryCount": 7, - "findingCount": 14, - "repoScore": 32.13333333333333, + "findingCount": 15, + "repoScore": 40.300000000000004, "physicalLineCount": 9408, "logicalLineCount": 2986, "functionCount": 147, "normalized": { - "scorePerFile": 1.0041666666666667, - "scorePerKloc": 10.761330654163874, - "scorePerFunction": 0.21859410430839002, - "findingsPerFile": 0.4375, - "findingsPerKloc": 4.688546550569323, - "findingsPerFunction": 0.09523809523809523 + "scorePerFile": 1.2593750000000001, + "scorePerKloc": 13.496316141995981, + "scorePerFunction": 0.2741496598639456, + "findingsPerFile": 0.46875, + "findingsPerKloc": 5.023442732752846, + "findingsPerFunction": 0.10204081632653061 } }, - "blendedScore": 3.3857673360055234, + "blendedScore": 8.990707848946045, "ruleCounts": { "defensive.error-swallowing": 10, + "defensive.stringified-unknown-errors": 2, "defensive.empty-catch": 1, - "structure.barrel-density": 1, - "structure.directory-fanout-hotspot": 1, + "defensive.promise-default-fallbacks": 1, "structure.pass-through-wrappers": 1 }, "topFiles": [ + { + "path": "src/components/NumberBaseConverter.tsx", + "score": 9.2, + "findingCount": 2 + }, + { + "path": "src/components/HashGenerator.tsx", + "score": 7.2, + "findingCount": 2 + }, { "path": "src/components/TextUtilities.tsx", "score": 6.2, @@ -119,29 +118,13 @@ "score": 3, "findingCount": 1 }, - { - "path": "src/components/ui/index.ts", - "score": 3, - "findingCount": 1 - }, { "path": "src/components/Base58EncoderDecoder.tsx", "score": 2.4000000000000004, "findingCount": 1 - }, - { - "path": "src/components/Base64EncoderDecoder.tsx", - "score": 2.4000000000000004, - "findingCount": 1 } ], - "topDirectories": [ - { - "path": "src/components", - "score": 4.833333333333334, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "fulling", @@ -151,75 +134,59 @@ "summary": { "fileCount": 219, "directoryCount": 78, - "findingCount": 36, - "repoScore": 115.59166666666668, + "findingCount": 64, + "repoScore": 279.29999999999995, "physicalLineCount": 26787, "logicalLineCount": 12154, "functionCount": 574, "normalized": { - "scorePerFile": 0.5278158295281584, - "scorePerKloc": 9.510586363885691, - "scorePerFunction": 0.20137921022067368, - "findingsPerFile": 0.1643835616438356, - "findingsPerKloc": 2.96198782293895, - "findingsPerFunction": 0.0627177700348432 + "scorePerFile": 1.2753424657534245, + "scorePerKloc": 22.980088859634684, + "scorePerFunction": 0.48658536585365847, + "findingsPerFile": 0.2922374429223744, + "findingsPerKloc": 5.265756129669245, + "findingsPerFunction": 0.11149825783972125 } }, - "blendedScore": 2.157199656063399, + "blendedScore": 10.241930243229788, "ruleCounts": { + "api.generic-status-envelopes": 31, "defensive.error-swallowing": 11, + "defensive.stringified-unknown-errors": 6, "defensive.error-obscuring": 5, - "structure.barrel-density": 4, "structure.pass-through-wrappers": 4, - "defensive.async-noise": 3, "defensive.empty-catch": 3, - "structure.directory-fanout-hotspot": 3, - "tests.duplicate-mock-setup": 3 + "tests.duplicate-mock-setup": 3, + "defensive.promise-default-fallbacks": 1 }, "topFiles": [ { - "path": "components/terminal/xterm-terminal.tsx", - "score": 9.2, - "findingCount": 2 + "path": "lib/k8s/sandbox-manager.ts", + "score": 21.2, + "findingCount": 4 }, { - "path": "lib/jobs/project-task/projectTaskReconcile.ts", - "score": 8, - "findingCount": 1 + "path": "lib/services/repoService.ts", + "score": 10, + "findingCount": 2 }, { - "path": "lib/jwt.ts", - "score": 8, - "findingCount": 1 + "path": "lib/platform/control/commands/skill/enable-global-skill.test.ts", + "score": 9.5, + "findingCount": 2 }, { - "path": "lib/util/ttyd-exec.ts", - "score": 6.5, + "path": "lib/platform/control/commands/skill/uninstall-global-skill.test.ts", + "score": 9.5, "findingCount": 2 }, { - "path": "components/terminal/hooks/use-file-drop.ts", - "score": 6, - "findingCount": 1 + "path": "components/terminal/xterm-terminal.tsx", + "score": 9.2, + "findingCount": 2 } ], - "topDirectories": [ - { - "path": "components/ui", - "score": 5.666666666666666, - "findingCount": 1 - }, - { - "path": "lib", - "score": 3.125, - "findingCount": 1 - }, - { - "path": "lib/platform/persistence/project-task", - "score": 3, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "openclaw", @@ -229,87 +196,60 @@ "summary": { "fileCount": 10465, "directoryCount": 423, - "findingCount": 3322, - "repoScore": 10933.93866868018, + "findingCount": 3136, + "repoScore": 11239.19999999997, "physicalLineCount": 1939647, "logicalLineCount": 1031409, "functionCount": 40348, "normalized": { - "scorePerFile": 1.0448101928982494, - "scorePerKloc": 10.600972716623744, - "scorePerFunction": 0.2709908463537271, - "findingsPerFile": 0.31743908265647397, - "findingsPerKloc": 3.2208367388688672, - "findingsPerFunction": 0.08233369683751363 + "scorePerFile": 1.073979933110365, + "scorePerKloc": 10.896938072093581, + "scorePerFunction": 0.2785565579458702, + "findingsPerFile": 0.29966555183946486, + "findingsPerKloc": 3.04050090701167, + "findingsPerFunction": 0.0777238029146426 } }, - "blendedScore": 3.0623746367298774, + "blendedScore": 6.910451841031872, "ruleCounts": { "tests.duplicate-mock-setup": 927, "structure.pass-through-wrappers": 618, - "structure.barrel-density": 412, "defensive.error-obscuring": 370, + "api.generic-status-envelopes": 345, + "defensive.promise-default-fallbacks": 335, "defensive.empty-catch": 322, - "defensive.async-noise": 315, - "structure.duplicate-function-signatures": 249, - "structure.directory-fanout-hotspot": 68, - "structure.over-fragmentation": 26, + "types.generic-record-casts": 123, + "defensive.stringified-unknown-errors": 81, "defensive.error-swallowing": 15 }, "topFiles": [ { - "path": "src/config/io.ts", - "score": 19.4, - "findingCount": 4 + "path": "extensions/matrix/src/matrix/sdk.ts", + "score": 35.5, + "findingCount": 6 }, { - "path": "extensions/msteams/src/attachments/shared.ts", - "score": 18.25, - "findingCount": 4 + "path": "extensions/zalouser/src/zalo-js.ts", + "score": 27, + "findingCount": 6 }, { - "path": "extensions/diffs/assets/viewer-runtime.js", - "score": 18, - "findingCount": 4 + "path": "src/config/io.ts", + "score": 25.4, + "findingCount": 5 }, { - "path": "extensions/matrix/src/matrix/sdk.ts", - "score": 17.5, - "findingCount": 4 + "path": "src/plugins/marketplace.ts", + "score": 24.7, + "findingCount": 6 }, { - "path": "src/agents/subagent-spawn.ts", - "score": 17, + "path": "scripts/dev/discord-acp-plain-language-smoke.ts", + "score": 22, "findingCount": 4 } ], - "topDirectories": [ - { - "path": "extensions/discord", - "score": 10.507936507936506, - "findingCount": 2 - }, - { - "path": "extensions/browser", - "score": 10.455357142857142, - "findingCount": 2 - }, - { - "path": "extensions/whatsapp", - "score": 10.409774436090226, - "findingCount": 2 - }, - { - "path": "extensions/slack", - "score": 10.338095238095239, - "findingCount": 2 - }, - { - "path": "extensions/telegram", - "score": 10.27310924369748, - "findingCount": 2 - } - ] + "topDirectories": [] }, { "id": "emdash", @@ -319,86 +259,60 @@ "summary": { "fileCount": 1072, "directoryCount": 306, - "findingCount": 239, - "repoScore": 787.2525793650789, + "findingCount": 237, + "repoScore": 915.6999999999998, "physicalLineCount": 257938, "logicalLineCount": 120432, "functionCount": 3513, "normalized": { - "scorePerFile": 0.7343774061241407, - "scorePerKloc": 6.536905302287423, - "scorePerFunction": 0.22409694829635038, - "findingsPerFile": 0.22294776119402984, - "findingsPerKloc": 1.9845223860767902, - "findingsPerFunction": 0.06803302021064617 + "scorePerFile": 0.8541977611940297, + "scorePerKloc": 7.603460874186261, + "scorePerFunction": 0.26066040421292336, + "findingsPerFile": 0.22108208955223882, + "findingsPerKloc": 1.967915504184934, + "findingsPerFunction": 0.06746370623398805 } }, - "blendedScore": 2.1744626927629422, + "blendedScore": 5.34967346171635, "ruleCounts": { - "structure.duplicate-function-signatures": 55, "defensive.empty-catch": 40, - "structure.barrel-density": 34, + "api.generic-status-envelopes": 39, + "defensive.promise-default-fallbacks": 39, "defensive.error-obscuring": 27, "structure.pass-through-wrappers": 27, "tests.duplicate-mock-setup": 21, - "structure.directory-fanout-hotspot": 17, + "defensive.stringified-unknown-errors": 20, "defensive.error-swallowing": 13, - "defensive.async-noise": 5 + "types.generic-record-casts": 11 }, "topFiles": [ { "path": "packages/core/src/emdash-runtime.ts", - "score": 23.7, - "findingCount": 4 + "score": 37.7, + "findingCount": 8 }, { "path": "packages/core/src/plugins/hooks.ts", - "score": 20, - "findingCount": 3 + "score": 28, + "findingCount": 4 }, { - "path": "packages/core/src/plugins/context.ts", - "score": 9, - "findingCount": 3 + "path": "packages/plugins/atproto/src/atproto.ts", + "score": 22.5, + "findingCount": 4 }, { - "path": "packages/marketplace/src/db/queries.ts", - "score": 9, - "findingCount": 2 + "path": "packages/core/src/api/handlers/marketplace.ts", + "score": 19, + "findingCount": 3 }, { - "path": "packages/cloudflare/src/db/playground-middleware.ts", - "score": 8, - "findingCount": 1 + "path": "packages/plugins/atproto/src/sandbox-entry.ts", + "score": 12, + "findingCount": 2 } ], - "topDirectories": [ - { - "path": "packages/core/src/database/migrations", - "score": 5.666666666666666, - "findingCount": 1 - }, - { - "path": "packages/admin/src/components", - "score": 5.1875, - "findingCount": 1 - }, - { - "path": "packages/admin/src/lib/api", - "score": 4.555555555555555, - "findingCount": 1 - }, - { - "path": "packages/cloudflare/src/db", - "score": 4.5, - "findingCount": 1 - }, - { - "path": "packages/core/src/cli/commands", - "score": 4.222222222222222, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "gstack", @@ -408,63 +322,59 @@ "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 92, - "repoScore": 411.59999999999985, + "findingCount": 99, + "repoScore": 460.0999999999997, "physicalLineCount": 62616, "logicalLineCount": 18958, "functionCount": 832, "normalized": { - "scorePerFile": 2.338636363636363, - "scorePerKloc": 21.71115096529169, - "scorePerFunction": 0.49471153846153826, - "findingsPerFile": 0.5227272727272727, - "findingsPerKloc": 4.852832577276084, - "findingsPerFunction": 0.11057692307692307 + "scorePerFile": 2.6142045454545437, + "scorePerKloc": 24.269437704399184, + "scorePerFunction": 0.5530048076923073, + "findingsPerFile": 0.5625, + "findingsPerKloc": 5.222069838590569, + "findingsPerFunction": 0.11899038461538461 } }, - "blendedScore": 5.332812749380866, + "blendedScore": 13.39827789824512, "ruleCounts": { "defensive.empty-catch": 55, "defensive.error-obscuring": 19, "defensive.error-swallowing": 8, + "defensive.promise-default-fallbacks": 7, "structure.pass-through-wrappers": 7, - "defensive.async-noise": 2, - "structure.directory-fanout-hotspot": 1 + "api.generic-status-envelopes": 1, + "defensive.stringified-unknown-errors": 1, + "types.generic-record-casts": 1 }, "topFiles": [ { "path": "browse/src/server.ts", - "score": 21.4, - "findingCount": 3 + "score": 25.4, + "findingCount": 4 }, { - "path": "browse/src/sidebar-agent.ts", - "score": 19.400000000000002, - "findingCount": 3 + "path": "browse/src/browser-manager.ts", + "score": 23.2, + "findingCount": 4 }, { - "path": "browse/src/cli.ts", - "score": 14.8, - "findingCount": 3 + "path": "browse/src/sidebar-agent.ts", + "score": 21.400000000000002, + "findingCount": 4 }, { - "path": "bin/gstack-global-discover.ts", - "score": 11.000000000000002, - "findingCount": 2 + "path": "browse/src/write-commands.ts", + "score": 17.6, + "findingCount": 3 }, { - "path": "test/skill-e2e.test.ts", - "score": 11, + "path": "extension/background.js", + "score": 15.200000000000001, "findingCount": 2 } ], - "topDirectories": [ - { - "path": "scripts", - "score": 3, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "hunk", @@ -474,30 +384,42 @@ "summary": { "fileCount": 166, "directoryCount": 36, - "findingCount": 21, - "repoScore": 63.87349206349206, + "findingCount": 25, + "repoScore": 75.4, "physicalLineCount": 32498, "logicalLineCount": 13564, "functionCount": 752, "normalized": { - "scorePerFile": 0.3847800726716389, - "scorePerKloc": 4.70904541901298, - "scorePerFunction": 0.08493815433975008, - "findingsPerFile": 0.12650602409638553, - "findingsPerKloc": 1.5482158655263933, - "findingsPerFunction": 0.027925531914893616 + "scorePerFile": 0.45421686746987955, + "scorePerKloc": 5.558832202890003, + "scorePerFunction": 0.10026595744680852, + "findingsPerFile": 0.15060240963855423, + "findingsPerKloc": 1.8431141256266588, + "findingsPerFunction": 0.03324468085106383 } }, - "blendedScore": 1.1834946976828806, + "blendedScore": 3.2139013779721544, "ruleCounts": { "defensive.error-obscuring": 6, "structure.pass-through-wrappers": 6, "defensive.empty-catch": 4, - "structure.directory-fanout-hotspot": 3, - "defensive.async-noise": 1, + "defensive.promise-default-fallbacks": 3, + "defensive.stringified-unknown-errors": 2, + "types.generic-record-casts": 2, + "api.generic-status-envelopes": 1, "defensive.error-swallowing": 1 }, "topFiles": [ + { + "path": "test/session/broker-e2e.test.ts", + "score": 11.7, + "findingCount": 2 + }, + { + "path": "src/core/updateNotice.ts", + "score": 7.2, + "findingCount": 3 + }, { "path": "src/session/commands.ts", "score": 7, @@ -512,35 +434,9 @@ "path": "src/ui/App.tsx", "score": 6, "findingCount": 2 - }, - { - "path": "test/session/broker-e2e.test.ts", - "score": 5.7, - "findingCount": 1 - }, - { - "path": "src/core/updateNotice.ts", - "score": 5.2, - "findingCount": 2 } ], - "topDirectories": [ - { - "path": "scripts", - "score": 3.2857142857142856, - "findingCount": 1 - }, - { - "path": "src/ui/lib", - "score": 3.2777777777777777, - "findingCount": 1 - }, - { - "path": "src/core", - "score": 3.16, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "vinext", @@ -550,37 +446,41 @@ "summary": { "fileCount": 1129, "directoryCount": 486, - "findingCount": 164, - "repoScore": 547.452724726254, + "findingCount": 136, + "repoScore": 449.79999999999995, "physicalLineCount": 150365, "logicalLineCount": 59523, "functionCount": 2917, "normalized": { - "scorePerFile": 0.4849005533447777, - "scorePerKloc": 9.19733085910075, - "scorePerFunction": 0.18767662829148235, - "findingsPerFile": 0.14526129317980513, - "findingsPerKloc": 2.7552374712296084, - "findingsPerFunction": 0.05622214604045252 + "scorePerFile": 0.39840566873339234, + "scorePerKloc": 7.556742771701694, + "scorePerFunction": 0.15419952005485085, + "findingsPerFile": 0.1204605845881311, + "findingsPerKloc": 2.2848310737026023, + "findingsPerFunction": 0.046623243057936234 } }, - "blendedScore": 1.986663972737263, + "blendedScore": 3.756547551060059, "ruleCounts": { - "structure.duplicate-function-signatures": 50, + "defensive.promise-default-fallbacks": 30, "structure.pass-through-wrappers": 29, "defensive.error-obscuring": 24, "tests.duplicate-mock-setup": 18, "defensive.empty-catch": 16, - "structure.directory-fanout-hotspot": 15, - "defensive.async-noise": 4, - "structure.barrel-density": 3, - "structure.over-fragmentation": 3, - "defensive.error-swallowing": 2 + "defensive.stringified-unknown-errors": 11, + "api.generic-status-envelopes": 5, + "defensive.error-swallowing": 2, + "types.generic-record-casts": 1 }, "topFiles": [ + { + "path": "tests/features.test.ts", + "score": 21, + "findingCount": 3 + }, { "path": "packages/vinext/src/index.ts", - "score": 14.65, + "score": 15.4, "findingCount": 3 }, { @@ -589,13 +489,8 @@ "findingCount": 3 }, { - "path": "tests/features.test.ts", - "score": 13, - "findingCount": 2 - }, - { - "path": "tests/pages-page-data.test.ts", - "score": 10.75, + "path": "packages/vinext/src/server/prod-server.ts", + "score": 13.2, "findingCount": 3 }, { @@ -604,33 +499,7 @@ "findingCount": 2 } ], - "topDirectories": [ - { - "path": "tests/fixtures/app-basic/app", - "score": 10.287878787878789, - "findingCount": 2 - }, - { - "path": "tests/fixtures/app-basic/app/nextjs-compat/dynamic", - "score": 10.166666666666668, - "findingCount": 2 - }, - { - "path": "tests/fixtures/pages-basic/pages/api", - "score": 10.166666666666666, - "findingCount": 2 - }, - { - "path": "tests/fixtures/pages-basic/pages", - "score": 6, - "findingCount": 1 - }, - { - "path": "packages/vinext/src/shims", - "score": 4.705882352941177, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "agent-ci", @@ -640,63 +509,57 @@ "summary": { "fileCount": 94, "directoryCount": 24, - "findingCount": 29, - "repoScore": 92.82500000000002, + "findingCount": 31, + "repoScore": 99.70000000000002, "physicalLineCount": 17222, "logicalLineCount": 8474, "functionCount": 220, "normalized": { - "scorePerFile": 0.9875000000000002, - "scorePerKloc": 10.954094878451736, - "scorePerFunction": 0.42193181818181824, - "findingsPerFile": 0.30851063829787234, - "findingsPerKloc": 3.422232711824404, - "findingsPerFunction": 0.1318181818181818 + "scorePerFile": 1.0606382978723405, + "scorePerKloc": 11.765400047203212, + "scorePerFunction": 0.45318181818181824, + "findingsPerFile": 0.32978723404255317, + "findingsPerKloc": 3.6582487609157424, + "findingsPerFunction": 0.1409090909090909 } }, - "blendedScore": 3.5709687976155604, + "blendedScore": 8.765234373695657, "ruleCounts": { "defensive.empty-catch": 18, "defensive.error-obscuring": 3, "defensive.error-swallowing": 3, + "defensive.promise-default-fallbacks": 3, "tests.duplicate-mock-setup": 3, - "structure.barrel-density": 1, - "structure.directory-fanout-hotspot": 1 + "api.generic-status-envelopes": 1 }, "topFiles": [ { - "path": "packages/cli/src/cli.ts", - "score": 8, + "path": "packages/cli/src/runner/local-job.ts", + "score": 14, "findingCount": 2 }, { - "path": "packages/cli/src/docker/shutdown.ts", - "score": 8, - "findingCount": 1 + "path": "packages/cli/src/docker/service-containers.ts", + "score": 9, + "findingCount": 2 }, { - "path": "packages/cli/src/runner/local-job.ts", + "path": "packages/cli/src/cli.ts", "score": 8, - "findingCount": 1 + "findingCount": 2 }, { - "path": "packages/cli/src/docker/service-containers.ts", - "score": 7, + "path": "packages/cli/src/docker/shutdown.ts", + "score": 8, "findingCount": 1 }, { - "path": "packages/cli/src/workflow/workflow-parser.ts", - "score": 5.9, + "path": "packages/dtu-github-actions/src/server/routes/actions/index.ts", + "score": 7.7, "findingCount": 2 } ], - "topDirectories": [ - { - "path": "packages/cli/src/output", - "score": 3.125, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "zustand", @@ -706,24 +569,22 @@ "summary": { "fileCount": 48, "directoryCount": 15, - "findingCount": 9, - "repoScore": 22.7, + "findingCount": 4, + "repoScore": 9.7, "physicalLineCount": 8814, "logicalLineCount": 7096, "functionCount": 161, "normalized": { - "scorePerFile": 0.47291666666666665, - "scorePerKloc": 3.198985343855693, - "scorePerFunction": 0.14099378881987576, - "findingsPerFile": 0.1875, - "findingsPerKloc": 1.2683201803833146, - "findingsPerFunction": 0.055900621118012424 + "scorePerFile": 0.2020833333333333, + "scorePerKloc": 1.3669673055242388, + "scorePerFunction": 0.06024844720496894, + "findingsPerFile": 0.08333333333333333, + "findingsPerKloc": 0.5636978579481398, + "findingsPerFunction": 0.024844720496894408 } }, - "blendedScore": 1.449021575841299, + "blendedScore": 1.4465620294744423, "ruleCounts": { - "structure.barrel-density": 3, - "structure.directory-fanout-hotspot": 2, "defensive.empty-catch": 1, "defensive.error-obscuring": 1, "defensive.error-swallowing": 1, @@ -735,11 +596,6 @@ "score": 4.7, "findingCount": 2 }, - { - "path": "src/middleware.ts", - "score": 3, - "findingCount": 1 - }, { "path": "src/middleware/persist.ts", "score": 3, @@ -749,25 +605,9 @@ "path": "examples/demo/src/utils/copy-to-clipboard.js", "score": 2, "findingCount": 1 - }, - { - "path": "src/index.ts", - "score": 2, - "findingCount": 1 } ], - "topDirectories": [ - { - "path": "examples/demo/src/components", - "score": 3, - "findingCount": 1 - }, - { - "path": "src/middleware", - "score": 3, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "payload", @@ -777,32 +617,29 @@ "summary": { "fileCount": 4234, "directoryCount": 1837, - "findingCount": 349, - "repoScore": 1018.4828107237586, + "findingCount": 101, + "repoScore": 308.70000000000005, "physicalLineCount": 384327, "logicalLineCount": 251992, "functionCount": 3544, "normalized": { - "scorePerFile": 0.24054860905143094, - "scorePerKloc": 4.04172676403917, - "scorePerFunction": 0.2873822829355978, - "findingsPerFile": 0.0824279641001417, - "findingsPerKloc": 1.3849646020508588, - "findingsPerFunction": 0.0984762979683973 + "scorePerFile": 0.07290977798771849, + "scorePerKloc": 1.2250388901234963, + "scorePerFunction": 0.08710496613995487, + "findingsPerFile": 0.023854511100614078, + "findingsPerKloc": 0.4008063748055494, + "findingsPerFunction": 0.02849887133182844 } }, - "blendedScore": 1.4739407776598403, + "blendedScore": 1, "ruleCounts": { - "structure.duplicate-function-signatures": 131, - "structure.directory-fanout-hotspot": 77, - "structure.barrel-density": 33, "defensive.error-swallowing": 29, "defensive.error-obscuring": 28, "defensive.empty-catch": 21, "structure.pass-through-wrappers": 13, - "defensive.async-noise": 6, "tests.duplicate-mock-setup": 6, - "structure.over-fragmentation": 5 + "defensive.promise-default-fallbacks": 3, + "api.generic-status-envelopes": 1 }, "topFiles": [ { @@ -821,43 +658,17 @@ "findingCount": 2 }, { - "path": "examples/localization/src/app/(frontend)/[locale]/[slug]/page.client.tsx", + "path": "packages/create-payload-app/src/lib/update-payload-in-project.ts", "score": 6, "findingCount": 1 }, { - "path": "examples/localization/src/app/(frontend)/[locale]/posts/[slug]/page.client.tsx", + "path": "test/live-preview/app/live-preview/(pages)/[slug]/page.tsx", "score": 6, - "findingCount": 1 - } - ], - "topDirectories": [ - { - "path": "packages/payload/src/exports/i18n", - "score": 13, - "findingCount": 2 - }, - { - "path": "packages/richtext-lexical/src/lexical-proxy/@lexical-react", - "score": 13, - "findingCount": 2 - }, - { - "path": "packages/payload/src/errors", - "score": 12.084291187739463, - "findingCount": 2 - }, - { - "path": "packages/richtext-lexical/src/lexical-proxy", - "score": 10.428571428571429, - "findingCount": 2 - }, - { - "path": "packages/plugin-cloud-storage", - "score": 10.166666666666668, "findingCount": 2 } - ] + ], + "topDirectories": [] }, { "id": "node-notifier", @@ -881,7 +692,7 @@ "findingsPerFunction": 0.023809523809523808 } }, - "blendedScore": 0.41256198156120816, + "blendedScore": 0.9450825271508594, "ruleCounts": { "defensive.empty-catch": 1 }, @@ -902,25 +713,24 @@ "summary": { "fileCount": 46, "directoryCount": 8, - "findingCount": 4, - "repoScore": 10.23076923076923, + "findingCount": 3, + "repoScore": 7, "physicalLineCount": 6456, "logicalLineCount": 2668, "functionCount": 140, "normalized": { - "scorePerFile": 0.22240802675585283, - "scorePerKloc": 3.8346211509629797, - "scorePerFunction": 0.07307692307692307, - "findingsPerFile": 0.08695652173913043, - "findingsPerKloc": 1.4992503748125936, - "findingsPerFunction": 0.02857142857142857 + "scorePerFile": 0.15217391304347827, + "scorePerKloc": 2.623688155922039, + "scorePerFunction": 0.05, + "findingsPerFile": 0.06521739130434782, + "findingsPerKloc": 1.1244377811094453, + "findingsPerFunction": 0.02142857142857143 } }, - "blendedScore": 0.9548338745328414, + "blendedScore": 1.566873209331136, "ruleCounts": { "structure.pass-through-wrappers": 2, - "defensive.error-obscuring": 1, - "structure.directory-fanout-hotspot": 1 + "defensive.error-obscuring": 1 }, "topFiles": [ { @@ -934,13 +744,7 @@ "findingCount": 1 } ], - "topDirectories": [ - { - "path": "src", - "score": 3.230769230769231, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "execa", @@ -950,28 +754,25 @@ "summary": { "fileCount": 580, "directoryCount": 46, - "findingCount": 28, - "repoScore": 99.01486212489861, + "findingCount": 13, + "repoScore": 50.9, "physicalLineCount": 35995, "logicalLineCount": 20374, "functionCount": 1007, "normalized": { - "scorePerFile": 0.17071527952568727, - "scorePerKloc": 4.859863655879975, - "scorePerFunction": 0.09832657609225284, - "findingsPerFile": 0.04827586206896552, - "findingsPerKloc": 1.37430057916953, - "findingsPerFunction": 0.027805362462760674 + "scorePerFile": 0.08775862068965518, + "scorePerKloc": 2.498282124276038, + "scorePerFunction": 0.05054617676266137, + "findingsPerFile": 0.022413793103448276, + "findingsPerKloc": 0.638068126042996, + "findingsPerFunction": 0.012909632571996028 } }, - "blendedScore": 0.8882847293047132, + "blendedScore": 0.9941091789864296, "ruleCounts": { "defensive.empty-catch": 11, - "structure.directory-fanout-hotspot": 7, - "structure.duplicate-function-signatures": 6, - "structure.over-fragmentation": 2, "defensive.error-obscuring": 1, - "structure.barrel-density": 1 + "defensive.promise-default-fallbacks": 1 }, "topFiles": [ { @@ -1000,33 +801,7 @@ "findingCount": 1 } ], - "topDirectories": [ - { - "path": "test/fixtures", - "score": 12.934306569343066, - "findingCount": 2 - }, - { - "path": "test/fixtures/nested", - "score": 7, - "findingCount": 1 - }, - { - "path": "test-d/stdio/option", - "score": 4.25, - "findingCount": 1 - }, - { - "path": "test-d/return", - "score": 3.2222222222222223, - "findingCount": 1 - }, - { - "path": "test/helpers", - "score": 3.083333333333333, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "hyper", @@ -1036,26 +811,25 @@ "summary": { "fileCount": 113, "directoryCount": 21, - "findingCount": 18, - "repoScore": 73.10000000000001, + "findingCount": 17, + "repoScore": 71.60000000000001, "physicalLineCount": 162735, "logicalLineCount": 65075, "functionCount": 5354, "normalized": { - "scorePerFile": 0.6469026548672567, - "scorePerKloc": 1.1233192470226663, - "scorePerFunction": 0.013653343294732912, - "findingsPerFile": 0.1592920353982301, - "findingsPerKloc": 0.27660391855551286, - "findingsPerFunction": 0.0033619723571161747 + "scorePerFile": 0.6336283185840709, + "scorePerKloc": 1.1002689204763736, + "scorePerFunction": 0.013373178931639897, + "findingsPerFile": 0.1504424778761062, + "findingsPerKloc": 0.2612370341913177, + "findingsPerFunction": 0.003175196115054165 } }, - "blendedScore": 0.4106818605605101, + "blendedScore": 0.9048406046474513, "ruleCounts": { "defensive.error-swallowing": 8, "structure.pass-through-wrappers": 5, "defensive.empty-catch": 3, - "defensive.async-noise": 1, "defensive.error-obscuring": 1 }, "topFiles": [ @@ -1095,35 +869,31 @@ "summary": { "fileCount": 512, "directoryCount": 87, - "findingCount": 34, - "repoScore": 89.34296536796535, + "findingCount": 11, + "repoScore": 30.3, "physicalLineCount": 29677, "logicalLineCount": 20508, "functionCount": 911, "normalized": { - "scorePerFile": 0.17449797923430732, - "scorePerKloc": 4.356493337622652, - "scorePerFunction": 0.09807131214924845, - "findingsPerFile": 0.06640625, - "findingsPerKloc": 1.6578896040569535, - "findingsPerFunction": 0.03732162458836443 + "scorePerFile": 0.0591796875, + "scorePerKloc": 1.4774722059684027, + "scorePerFunction": 0.03326015367727772, + "findingsPerFile": 0.021484375, + "findingsPerKloc": 0.5363760483713673, + "findingsPerFunction": 0.012074643249176729 } }, - "blendedScore": 1, + "blendedScore": 0.7588021389046449, "ruleCounts": { - "structure.duplicate-function-signatures": 12, - "structure.directory-fanout-hotspot": 6, "defensive.empty-catch": 4, "defensive.error-obscuring": 4, - "structure.barrel-density": 3, - "structure.pass-through-wrappers": 3, - "defensive.async-noise": 2 + "structure.pass-through-wrappers": 3 }, "topFiles": [ { "path": "src/lib/auth.ts", - "score": 5.75, - "findingCount": 3 + "score": 5, + "findingCount": 2 }, { "path": "scripts/check-db.js", @@ -1146,33 +916,7 @@ "findingCount": 1 } ], - "topDirectories": [ - { - "path": "src/lib", - "score": 5.125, - "findingCount": 1 - }, - { - "path": "src/components/hooks/queries", - "score": 4.133333333333333, - "findingCount": 1 - }, - { - "path": "src/pages/api/reports", - "score": 3.5, - "findingCount": 1 - }, - { - "path": "src/app/(main)/profile", - "score": 3.428571428571429, - "findingCount": 1 - }, - { - "path": "src/app/(main)/reports/[reportId]", - "score": 3.333333333333333, - "findingCount": 1 - } - ] + "topDirectories": [] }, { "id": "vite", @@ -1182,36 +926,33 @@ "summary": { "fileCount": 1229, "directoryCount": 525, - "findingCount": 94, - "repoScore": 304.9507936507937, + "findingCount": 52, + "repoScore": 149.70000000000002, "physicalLineCount": 77629, "logicalLineCount": 37251, "functionCount": 1904, "normalized": { - "scorePerFile": 0.2481292055742829, - "scorePerKloc": 8.186378718713422, - "scorePerFunction": 0.16016323195945045, - "findingsPerFile": 0.07648494711147275, - "findingsPerKloc": 2.523422190008322, - "findingsPerFunction": 0.04936974789915966 + "scorePerFile": 0.12180634662327097, + "scorePerKloc": 4.018684062172828, + "scorePerFunction": 0.07862394957983194, + "findingsPerFile": 0.04231082180634662, + "findingsPerKloc": 1.3959356795790718, + "findingsPerFunction": 0.0273109243697479 } }, - "blendedScore": 1.4707114224260587, + "blendedScore": 1.7556654238671972, "ruleCounts": { "structure.pass-through-wrappers": 25, - "structure.directory-fanout-hotspot": 21, "defensive.empty-catch": 13, - "defensive.async-noise": 8, - "structure.barrel-density": 8, - "structure.over-fragmentation": 8, "defensive.error-swallowing": 6, - "defensive.error-obscuring": 5 + "defensive.error-obscuring": 5, + "defensive.promise-default-fallbacks": 3 }, "topFiles": [ { "path": "packages/vite/src/node/server/pluginContainer.ts", - "score": 11.05, - "findingCount": 3 + "score": 8.8, + "findingCount": 2 }, { "path": "packages/vite/src/node/utils.ts", @@ -1229,38 +970,12 @@ "findingCount": 2 }, { - "path": "packages/vite/src/node/server/moduleGraph.ts", - "score": 5.75, + "path": "packages/vite/src/node/optimizer/index.ts", + "score": 5.800000000000001, "findingCount": 2 } ], - "topDirectories": [ - { - "path": "playground/legacy", - "score": 11.166666666666666, - "findingCount": 2 - }, - { - "path": "playground/js-sourcemap", - "score": 11.1, - "findingCount": 2 - }, - { - "path": "playground/lib/src", - "score": 10.5, - "findingCount": 2 - }, - { - "path": "playground/html/inline", - "score": 10, - "findingCount": 2 - }, - { - "path": "playground/ssr-html/src", - "score": 10, - "findingCount": 2 - } - ] + "topDirectories": [] }, { "id": "astro", @@ -1270,31 +985,29 @@ "summary": { "fileCount": 1949, "directoryCount": 852, - "findingCount": 187, - "repoScore": 546.0060606060604, + "findingCount": 107, + "repoScore": 314.8999999999999, "physicalLineCount": 138854, "logicalLineCount": 80948, "functionCount": 3018, "normalized": { - "scorePerFile": 0.2801467730149104, - "scorePerKloc": 6.745145780081786, - "scorePerFunction": 0.18091652107556672, - "findingsPerFile": 0.09594663930220626, - "findingsPerKloc": 2.3101250185304147, - "findingsPerFunction": 0.06196156394963552 + "scorePerFile": 0.16157003591585425, + "scorePerKloc": 3.8901517023274192, + "scorePerFunction": 0.10434062292909209, + "findingsPerFile": 0.05489994869163674, + "findingsPerKloc": 1.3218362405494886, + "findingsPerFunction": 0.03545394300861498 } }, - "blendedScore": 1.576067128942098, + "blendedScore": 2.074024704430854, "ruleCounts": { "defensive.empty-catch": 39, - "structure.duplicate-function-signatures": 28, - "structure.barrel-density": 27, "defensive.error-obscuring": 26, - "structure.directory-fanout-hotspot": 24, "structure.pass-through-wrappers": 24, - "defensive.async-noise": 11, + "defensive.promise-default-fallbacks": 9, "defensive.error-swallowing": 7, - "structure.over-fragmentation": 1 + "api.generic-status-envelopes": 1, + "defensive.stringified-unknown-errors": 1 }, "topFiles": [ { @@ -1318,62 +1031,36 @@ "findingCount": 2 }, { - "path": "packages/astro/src/transitions/router.ts", - "score": 8, - "findingCount": 1 + "path": "packages/astro/src/core/dev/dev.ts", + "score": 8.7, + "findingCount": 4 } ], - "topDirectories": [ - { - "path": "packages/astro/src/runtime/client", - "score": 6.5, - "findingCount": 1 - }, - { - "path": "packages/astro/src/vite-plugin-astro-server", - "score": 4.5, - "findingCount": 1 - }, - { - "path": "packages/astro/src/core", - "score": 4.333333333333334, - "findingCount": 1 - }, - { - "path": "packages/astro/src/core/build/plugins", - "score": 4.333333333333334, - "findingCount": 1 - }, - { - "path": "packages/astro/src/content", - "score": 4.166666666666666, - "findingCount": 1 - } - ] + "topDirectories": [] } ], "cohorts": { "explicit-ai": { "repoCount": 9, "medians": { - "scorePerFile": 0.9875000000000002, - "scorePerKloc": 9.510586363885691, - "scorePerFunction": 0.22409694829635038, - "findingsPerFile": 0.30851063829787234, - "findingsPerKloc": 2.96198782293895, - "findingsPerFunction": 0.08233369683751363 + "scorePerFile": 1.073979933110365, + "scorePerKloc": 10.896938072093581, + "scorePerFunction": 0.2785565579458702, + "findingsPerFile": 0.2949640287769784, + "findingsPerKloc": 3.04050090701167, + "findingsPerFunction": 0.0835030549898167 }, - "blendedScoreMedian": 3.016806784725735 + "blendedScoreMedian": 6.910451841031872 }, "mature-oss": { "repoCount": 9, "medians": { - "scorePerFile": 0.24054860905143094, - "scorePerKloc": 4.04172676403917, - "scorePerFunction": 0.09832657609225284, - "findingsPerFile": 0.0824279641001417, - "findingsPerKloc": 1.3849646020508588, - "findingsPerFunction": 0.03732162458836443 + "scorePerFile": 0.12180634662327097, + "scorePerKloc": 1.4774722059684027, + "scorePerFunction": 0.05054617676266137, + "findingsPerFile": 0.04231082180634662, + "findingsPerKloc": 0.5636978579481398, + "findingsPerFunction": 0.023809523809523808 }, "blendedScoreMedian": 1 } @@ -1384,12 +1071,12 @@ "solidRepoId": "hyper", "notes": "GUI-oriented TypeScript app vs older terminal/desktop-style TS app.", "ratios": { - "scorePerFile": 1.5522685818513449, - "scorePerKloc": 9.579939703416061, - "scorePerFunction": 16.010298693120657, - "findingsPerFile": 2.7465277777777777, - "findingsPerKloc": 16.95039815434993, - "findingsPerFunction": 28.32804232804233 + "scorePerFile": 1.9875611033519553, + "scorePerKloc": 12.26637951034062, + "scorePerFunction": 20.499961995971574, + "findingsPerFile": 3.1158088235294117, + "findingsPerKloc": 19.229443284346555, + "findingsPerFunction": 32.13685474189676 } }, { @@ -1397,12 +1084,12 @@ "solidRepoId": "umami", "notes": "Full-stack analytics-adjacent SaaS-style app comparison and negative control.", "ratios": { - "scorePerFile": 7.268996840868781, - "scorePerKloc": 1.8172823605311448, - "scorePerFunction": 3.6614761048974236, - "findingsPerFile": 4.9834955564959795, - "findingsPerKloc": 1.2458966163924032, - "findingsPerFunction": 2.510243201150114 + "scorePerFile": 20.629769451765316, + "scorePerKloc": 5.157536445157762, + "scorePerFunction": 10.391448717173141, + "findingsPerFile": 13.729234793982995, + "findingsPerKloc": 3.4323713107727474, + "findingsPerFunction": 6.915571190520273 } }, { @@ -1410,12 +1097,12 @@ "solidRepoId": "vite", "notes": "AI-built Vite-based framework layer vs the mature Vite baseline.", "ratios": { - "scorePerFile": 1.9542260340635804, - "scorePerKloc": 1.1234919828563965, - "scorePerFunction": 1.1717834736189492, - "findingsPerFile": 1.8992141416806436, - "findingsPerKloc": 1.0918654366039802, - "findingsPerFunction": 1.1387975112874638 + "scorePerFile": 3.270812069962185, + "scorePerKloc": 1.8804023045334655, + "scorePerFunction": 1.9612283646254909, + "findingsPerFile": 2.847039585746406, + "findingsPerKloc": 1.6367738908941467, + "findingsPerFunction": 1.707127976582896 } } ] diff --git a/benchmarks/results/rule-signal-mini.json b/benchmarks/results/rule-signal-mini.json index e0bcb1e..0d3a22c 100644 --- a/benchmarks/results/rule-signal-mini.json +++ b/benchmarks/results/rule-signal-mini.json @@ -2,7 +2,7 @@ "schemaVersion": 1, "benchmarkSetId": "rule-signal-mini", "benchmarkSetName": "Per-rule signal mini benchmark", - "generatedAt": "2026-04-19T02:29:58.464Z", + "generatedAt": "2026-04-26T18:00:34.008Z", "analyzerVersion": "0.3.0", "artifacts": { "manifestPath": "benchmarks/sets/rule-signal-mini.json", @@ -11,23 +11,23 @@ }, "rules": [ { - "ruleId": "defensive.error-swallowing", - "ruleSlug": "error-swallowing", + "ruleId": "defensive.promise-default-fallbacks", + "ruleSlug": "promise-default-fallbacks", "family": "defensive", "severity": "strong", "scope": "file", "requires": [ - "file.tryCatchSummaries" + "file.ast" ], - "signalScore": 0.7166666666666668, + "signalScore": 0.8111111111111112, "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.8666666666666667, + "bestMetricAuc": 1, "metricAucs": { - "scorePerFile": 0.8666666666666667, - "scorePerKloc": 0.8, + "scorePerFile": 1, + "scorePerKloc": 0.9666666666666667, "scorePerFunction": 0.5, - "findingsPerFile": 0.8666666666666667, - "findingsPerKloc": 0.7666666666666667, + "findingsPerFile": 1, + "findingsPerKloc": 0.9, "findingsPerFunction": 0.5 }, "cohorts": { @@ -35,29 +35,29 @@ "repoCount": 6, "hitCount": 6, "hitRate": 1, - "repoScoreMedian": 9.1, + "repoScoreMedian": 10, "findingCountMedian": 3, "medians": { - "scorePerFile": 0.0695086484004286, - "scorePerKloc": 0.5267386471458326, + "scorePerFile": 0.09172116163805288, + "scorePerKloc": 1.3208500617435162, "scorePerFunction": null, - "findingsPerFile": 0.026748813714985456, - "findingsPerKloc": 0.24436722316785256, + "findingsPerFile": 0.028911093888396813, + "findingsPerKloc": 0.3444601279102652, "findingsPerFunction": null } }, "mature-oss": { "repoCount": 5, - "hitCount": 3, - "hitRate": 0.6, - "repoScoreMedian": 13.8, - "findingCountMedian": 6, + "hitCount": 4, + "hitRate": 0.8, + "repoScoreMedian": 6, + "findingCountMedian": 3, "medians": { - "scorePerFile": 0.007080554130323243, - "scorePerKloc": 0.17047981420170977, + "scorePerFile": 0.0034482758620689655, + "scorePerKloc": 0.09816432708353785, "scorePerFunction": null, - "findingsPerFile": 0.0035915854284248334, - "findingsPerKloc": 0.08647526807333103, + "findingsPerFile": 0.0017241379310344827, + "findingsPerKloc": 0.049082163541768926, "findingsPerFunction": null } } @@ -71,17 +71,17 @@ "summary": { "fileCount": 32, "directoryCount": 7, - "findingCount": 10, - "repoScore": 17.4, + "findingCount": 1, + "repoScore": 8, "physicalLineCount": 9408, "logicalLineCount": 2986, "functionCount": 0, "normalized": { - "scorePerFile": 0.54375, - "scorePerKloc": 5.827193569993301, + "scorePerFile": 0.25, + "scorePerKloc": 2.6791694574681846, "scorePerFunction": null, - "findingsPerFile": 0.3125, - "findingsPerKloc": 3.348961821835231, + "findingsPerFile": 0.03125, + "findingsPerKloc": 0.3348961821835231, "findingsPerFunction": null } } @@ -94,40 +94,40 @@ "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 8, - "repoScore": 37.400000000000006, + "findingCount": 7, + "repoScore": 40, "physicalLineCount": 62616, "logicalLineCount": 18958, "functionCount": 0, "normalized": { - "scorePerFile": 0.21250000000000002, - "scorePerKloc": 1.972781939023104, + "scorePerFile": 0.22727272727272727, + "scorePerKloc": 2.109927207511341, "scorePerFunction": null, - "findingsPerFile": 0.045454545454545456, - "findingsPerKloc": 0.4219854415022682, + "findingsPerFile": 0.03977272727272727, + "findingsPerKloc": 0.3692372613144847, "findingsPerFunction": null } } }, { - "id": "openusage", - "repo": "robinebers/openusage", + "id": "vinext", + "repo": "cloudflare/vinext", "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "ref": "28980b01f1692b47756a6768fc5733712c290f84", "summary": { - "fileCount": 139, - "directoryCount": 29, - "findingCount": 3, - "repoScore": 14, - "physicalLineCount": 33794, - "logicalLineCount": 22270, + "fileCount": 1129, + "directoryCount": 486, + "findingCount": 30, + "repoScore": 87, + "physicalLineCount": 150365, + "logicalLineCount": 59523, "functionCount": 0, "normalized": { - "scorePerFile": 0.10071942446043165, - "scorePerKloc": 0.6286484059272565, + "scorePerFile": 0.07705934455270151, + "scorePerKloc": 1.461619878030341, "scorePerFunction": null, - "findingsPerFile": 0.02158273381294964, - "findingsPerKloc": 0.1347103726986978, + "findingsPerFile": 0.026572187776793623, + "findingsPerKloc": 0.5040068544932211, "findingsPerFunction": null } } @@ -141,13 +141,13 @@ "fileCount": 94, "directoryCount": 24, "findingCount": 3, - "repoScore": 3.6000000000000005, + "repoScore": 10, "physicalLineCount": 17222, "logicalLineCount": 8474, "functionCount": 0, "normalized": { - "scorePerFile": 0.03829787234042554, - "scorePerKloc": 0.42482888836440885, + "scorePerFile": 0.10638297872340426, + "scorePerKloc": 1.180080245456691, "scorePerFunction": null, "findingsPerFile": 0.031914893617021274, "findingsPerKloc": 0.35402407363700733, @@ -163,132 +163,132 @@ "summary": { "fileCount": 166, "directoryCount": 36, - "findingCount": 1, - "repoScore": 3, + "findingCount": 3, + "repoScore": 10, "physicalLineCount": 32498, "logicalLineCount": 13564, "functionCount": 0, "normalized": { - "scorePerFile": 0.018072289156626505, - "scorePerKloc": 0.22117369507519904, + "scorePerFile": 0.060240963855421686, + "scorePerKloc": 0.7372456502506635, "scorePerFunction": null, - "findingsPerFile": 0.006024096385542169, - "findingsPerKloc": 0.07372456502506636, + "findingsPerFile": 0.018072289156626505, + "findingsPerKloc": 0.22117369507519904, "findingsPerFunction": null } } }, { - "id": "vinext", - "repo": "cloudflare/vinext", + "id": "openusage", + "repo": "robinebers/openusage", "cohort": "explicit-ai", - "ref": "28980b01f1692b47756a6768fc5733712c290f84", + "ref": "857f537a243483acf98ccd9ea32e20b380c63823", "summary": { - "fileCount": 1129, - "directoryCount": 486, - "findingCount": 2, - "repoScore": 4.2, - "physicalLineCount": 150365, - "logicalLineCount": 59523, + "fileCount": 139, + "directoryCount": 29, + "findingCount": 1, + "repoScore": 4, + "physicalLineCount": 33794, + "logicalLineCount": 22270, "functionCount": 0, "normalized": { - "scorePerFile": 0.003720106288751107, - "scorePerKloc": 0.07056095962905096, + "scorePerFile": 0.02877697841726619, + "scorePerKloc": 0.1796138302649304, "scorePerFunction": null, - "findingsPerFile": 0.001771479185119575, - "findingsPerKloc": 0.03360045696621474, + "findingsPerFile": 0.007194244604316547, + "findingsPerKloc": 0.0449034575662326, "findingsPerFunction": null } } }, { - "id": "vite", - "repo": "vitejs/vite", + "id": "astro", + "repo": "withastro/astro", "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", + "ref": "f7068995aa451dced13853789b0d51433c2373b5", "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 6, - "repoScore": 19.2, - "physicalLineCount": 77629, - "logicalLineCount": 37251, + "fileCount": 1949, + "directoryCount": 852, + "findingCount": 9, + "repoScore": 20.5, + "physicalLineCount": 138854, + "logicalLineCount": 80948, "functionCount": 0, "normalized": { - "scorePerFile": 0.015622457282343368, - "scorePerKloc": 0.5154224047676572, + "scorePerFile": 0.01051821446895844, + "scorePerKloc": 0.2532489993576123, "scorePerFunction": null, - "findingsPerFile": 0.004882017900732303, - "findingsPerKloc": 0.1610695014898929, + "findingsPerFile": 0.004617752693689072, + "findingsPerKloc": 0.11118248752285419, "findingsPerFunction": null } } }, { - "id": "payload", - "repo": "payloadcms/payload", + "id": "vite", + "repo": "vitejs/vite", "cohort": "mature-oss", - "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", + "ref": "a4922537a8d705da7769d30626a0d846511fc124", "summary": { - "fileCount": 4234, - "directoryCount": 1837, - "findingCount": 29, - "repoScore": 84.80000000000001, - "physicalLineCount": 384327, - "logicalLineCount": 251992, + "fileCount": 1229, + "directoryCount": 525, + "findingCount": 3, + "repoScore": 6, + "physicalLineCount": 77629, + "logicalLineCount": 37251, "functionCount": 0, "normalized": { - "scorePerFile": 0.02002834199338687, - "scorePerKloc": 0.33651861963871876, + "scorePerFile": 0.004882017900732303, + "scorePerKloc": 0.1610695014898929, "scorePerFunction": null, - "findingsPerFile": 0.00684931506849315, - "findingsPerKloc": 0.11508301850852408, + "findingsPerFile": 0.0024410089503661514, + "findingsPerKloc": 0.08053475074494645, "findingsPerFunction": null } } }, { - "id": "astro", - "repo": "withastro/astro", + "id": "execa", + "repo": "sindresorhus/execa", "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", + "ref": "99d1741d2525eca71b986282148bbf2983356428", "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 7, - "repoScore": 13.8, - "physicalLineCount": 138854, - "logicalLineCount": 80948, + "fileCount": 580, + "directoryCount": 46, + "findingCount": 1, + "repoScore": 2, + "physicalLineCount": 35995, + "logicalLineCount": 20374, "functionCount": 0, "normalized": { - "scorePerFile": 0.007080554130323243, - "scorePerKloc": 0.17047981420170977, + "scorePerFile": 0.0034482758620689655, + "scorePerKloc": 0.09816432708353785, "scorePerFunction": null, - "findingsPerFile": 0.0035915854284248334, - "findingsPerKloc": 0.08647526807333103, + "findingsPerFile": 0.0017241379310344827, + "findingsPerKloc": 0.049082163541768926, "findingsPerFunction": null } } }, { - "id": "execa", - "repo": "sindresorhus/execa", + "id": "payload", + "repo": "payloadcms/payload", "cohort": "mature-oss", - "ref": "99d1741d2525eca71b986282148bbf2983356428", + "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", "summary": { - "fileCount": 580, - "directoryCount": 46, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 35995, - "logicalLineCount": 20374, + "fileCount": 4234, + "directoryCount": 1837, + "findingCount": 3, + "repoScore": 6, + "physicalLineCount": 384327, + "logicalLineCount": 251992, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.0014170996693434106, + "scorePerKloc": 0.023810279691418777, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.0007085498346717053, + "findingsPerKloc": 0.011905139845709388, "findingsPerFunction": null } } @@ -320,53 +320,53 @@ "rank": 1 }, { - "ruleId": "defensive.empty-catch", - "ruleSlug": "empty-catch", - "family": "defensive", + "ruleId": "api.generic-status-envelopes", + "ruleSlug": "generic-status-envelopes", + "family": "api", "severity": "strong", "scope": "file", "requires": [ - "file.tryCatchSummaries" + "file.ast" ], - "signalScore": 0.6666666666666666, + "signalScore": 0.7555555555555555, "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.9333333333333333, + "bestMetricAuc": 0.8833333333333333, "metricAucs": { - "scorePerFile": 0.8666666666666667, - "scorePerKloc": 0.6333333333333333, + "scorePerFile": 0.8833333333333333, + "scorePerKloc": 0.8833333333333333, "scorePerFunction": 0.5, - "findingsPerFile": 0.9333333333333333, - "findingsPerKloc": 0.5666666666666667, + "findingsPerFile": 0.8833333333333333, + "findingsPerKloc": 0.8833333333333333, "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, - "hitCount": 6, - "hitRate": 1, - "repoScoreMedian": 42.3, - "findingCountMedian": 10, + "hitCount": 5, + "hitRate": 0.8333333333333334, + "repoScoreMedian": 5, + "findingCountMedian": 1, "medians": { - "scorePerFile": 0.11837132703475772, - "scorePerKloc": 1.2343535610214642, + "scorePerFile": 0.01683847502025894, + "scorePerKloc": 0.23560962392742069, "scorePerFunction": null, - "findingsPerFile": 0.030013489208633094, - "findingsPerKloc": 0.3148972211418942, + "findingsPerFile": 0.0058529572836801755, + "findingsPerKloc": 0.06323637260642494, "findingsPerFunction": null } }, "mature-oss": { "repoCount": 5, - "hitCount": 5, - "hitRate": 1, - "repoScoreMedian": 45.1, - "findingCountMedian": 13, + "hitCount": 2, + "hitRate": 0.4, + "repoScoreMedian": 0, + "findingCountMedian": 0, "medians": { - "scorePerFile": 0.036696501220504475, - "scorePerKloc": 1.210705752865695, + "scorePerFile": 0, + "scorePerKloc": 0, "scorePerFunction": null, - "findingsPerFile": 0.010577705451586655, - "findingsPerKloc": 0.34898391989476796, + "findingsPerFile": 0, + "findingsPerKloc": 0, "findingsPerFunction": null } } @@ -380,17 +380,40 @@ "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 55, - "repoScore": 301.3, + "findingCount": 1, + "repoScore": 8, "physicalLineCount": 62616, "logicalLineCount": 18958, "functionCount": 0, "normalized": { - "scorePerFile": 1.7119318181818182, - "scorePerKloc": 15.893026690579177, + "scorePerFile": 0.045454545454545456, + "scorePerKloc": 0.4219854415022682, "scorePerFunction": null, - "findingsPerFile": 0.3125, - "findingsPerKloc": 2.901149910328094, + "findingsPerFile": 0.005681818181818182, + "findingsPerKloc": 0.052748180187783524, + "findingsPerFunction": null + } + } + }, + { + "id": "openusage", + "repo": "robinebers/openusage", + "cohort": "explicit-ai", + "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "summary": { + "fileCount": 139, + "directoryCount": 29, + "findingCount": 1, + "repoScore": 8, + "physicalLineCount": 33794, + "logicalLineCount": 22270, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.05755395683453238, + "scorePerKloc": 0.3592276605298608, + "scorePerFunction": null, + "findingsPerFile": 0.007194244604316547, + "findingsPerKloc": 0.0449034575662326, "findingsPerFunction": null } } @@ -403,40 +426,17 @@ "summary": { "fileCount": 94, "directoryCount": 24, - "findingCount": 18, - "repoScore": 69.3, + "findingCount": 1, + "repoScore": 2, "physicalLineCount": 17222, "logicalLineCount": 8474, "functionCount": 0, "normalized": { - "scorePerFile": 0.7372340425531915, - "scorePerKloc": 8.17795610101487, - "scorePerFunction": null, - "findingsPerFile": 0.19148936170212766, - "findingsPerKloc": 2.1241444418220436, - "findingsPerFunction": null - } - } - }, - { - "id": "hunk", - "repo": "modem-dev/hunk", - "cohort": "explicit-ai", - "ref": "b37663f3c3055f860290587865199192e15d9f35", - "summary": { - "fileCount": 166, - "directoryCount": 36, - "findingCount": 4, - "repoScore": 18.4, - "physicalLineCount": 32498, - "logicalLineCount": 13564, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.1108433734939759, - "scorePerKloc": 1.3565319964612208, + "scorePerFile": 0.02127659574468085, + "scorePerKloc": 0.2360160490913382, "scorePerFunction": null, - "findingsPerFile": 0.024096385542168676, - "findingsPerKloc": 0.29489826010026543, + "findingsPerFile": 0.010638297872340425, + "findingsPerKloc": 0.1180080245456691, "findingsPerFunction": null } } @@ -449,40 +449,40 @@ "summary": { "fileCount": 1129, "directoryCount": 486, - "findingCount": 16, - "repoScore": 66.19999999999999, + "findingCount": 5, + "repoScore": 14, "physicalLineCount": 150365, "logicalLineCount": 59523, "functionCount": 0, "normalized": { - "scorePerFile": 0.05863596102745792, - "scorePerKloc": 1.1121751255817076, + "scorePerFile": 0.012400354295837024, + "scorePerKloc": 0.23520319876350318, "scorePerFunction": null, - "findingsPerFile": 0.0141718334809566, - "findingsPerKloc": 0.2688036557297179, + "findingsPerFile": 0.0044286979627989375, + "findingsPerKloc": 0.08400114241553684, "findingsPerFunction": null } } }, { - "id": "openusage", - "repo": "robinebers/openusage", + "id": "hunk", + "repo": "modem-dev/hunk", "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "ref": "b37663f3c3055f860290587865199192e15d9f35", "summary": { - "fileCount": 139, - "directoryCount": 29, - "findingCount": 4, - "repoScore": 17.5, - "physicalLineCount": 33794, - "logicalLineCount": 22270, + "fileCount": 166, + "directoryCount": 36, + "findingCount": 1, + "repoScore": 2, + "physicalLineCount": 32498, + "logicalLineCount": 13564, "functionCount": 0, "normalized": { - "scorePerFile": 0.12589928057553956, - "scorePerKloc": 0.7858105074090705, + "scorePerFile": 0.012048192771084338, + "scorePerKloc": 0.14744913005013272, "scorePerFunction": null, - "findingsPerFile": 0.02877697841726619, - "findingsPerKloc": 0.1796138302649304, + "findingsPerFile": 0.006024096385542169, + "findingsPerKloc": 0.07372456502506636, "findingsPerFunction": null } } @@ -495,86 +495,86 @@ "summary": { "fileCount": 32, "directoryCount": 7, - "findingCount": 1, - "repoScore": 1.9000000000000001, + "findingCount": 0, + "repoScore": 0, "physicalLineCount": 9408, "logicalLineCount": 2986, "functionCount": 0, "normalized": { - "scorePerFile": 0.059375000000000004, - "scorePerKloc": 0.6363027461486939, + "scorePerFile": 0, + "scorePerKloc": 0, "scorePerFunction": null, - "findingsPerFile": 0.03125, - "findingsPerKloc": 0.3348961821835231, + "findingsPerFile": 0, + "findingsPerKloc": 0, "findingsPerFunction": null } } }, { - "id": "execa", - "repo": "sindresorhus/execa", + "id": "astro", + "repo": "withastro/astro", "cohort": "mature-oss", - "ref": "99d1741d2525eca71b986282148bbf2983356428", + "ref": "f7068995aa451dced13853789b0d51433c2373b5", "summary": { - "fileCount": 580, - "directoryCount": 46, - "findingCount": 11, - "repoScore": 43.9, - "physicalLineCount": 35995, - "logicalLineCount": 20374, + "fileCount": 1949, + "directoryCount": 852, + "findingCount": 1, + "repoScore": 2, + "physicalLineCount": 138854, + "logicalLineCount": 80948, "functionCount": 0, "normalized": { - "scorePerFile": 0.07568965517241379, - "scorePerKloc": 2.1547069794836555, + "scorePerFile": 0.001026167265264238, + "scorePerKloc": 0.024707219449523154, "scorePerFunction": null, - "findingsPerFile": 0.01896551724137931, - "findingsPerKloc": 0.5399037989594582, + "findingsPerFile": 0.000513083632632119, + "findingsPerKloc": 0.012353609724761577, "findingsPerFunction": null } } }, { - "id": "astro", - "repo": "withastro/astro", + "id": "payload", + "repo": "payloadcms/payload", "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", + "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 39, - "repoScore": 133.90000000000006, - "physicalLineCount": 138854, - "logicalLineCount": 80948, + "fileCount": 4234, + "directoryCount": 1837, + "findingCount": 1, + "repoScore": 6, + "physicalLineCount": 384327, + "logicalLineCount": 251992, "functionCount": 0, "normalized": { - "scorePerFile": 0.06870189840944077, - "scorePerKloc": 1.6541483421455758, + "scorePerFile": 0.0014170996693434106, + "scorePerKloc": 0.023810279691418777, "scorePerFunction": null, - "findingsPerFile": 0.020010261672652643, - "findingsPerKloc": 0.48179077926570146, + "findingsPerFile": 0.00023618327822390176, + "findingsPerKloc": 0.003968379948569796, "findingsPerFunction": null } } }, { - "id": "vite", - "repo": "vitejs/vite", + "id": "execa", + "repo": "sindresorhus/execa", "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", + "ref": "99d1741d2525eca71b986282148bbf2983356428", "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 13, - "repoScore": 45.1, - "physicalLineCount": 77629, - "logicalLineCount": 37251, + "fileCount": 580, + "directoryCount": 46, + "findingCount": 0, + "repoScore": 0, + "physicalLineCount": 35995, + "logicalLineCount": 20374, "functionCount": 0, "normalized": { - "scorePerFile": 0.036696501220504475, - "scorePerKloc": 1.210705752865695, + "scorePerFile": 0, + "scorePerKloc": 0, "scorePerFunction": null, - "findingsPerFile": 0.010577705451586655, - "findingsPerKloc": 0.34898391989476796, + "findingsPerFile": 0, + "findingsPerKloc": 0, "findingsPerFunction": null } } @@ -587,40 +587,40 @@ "summary": { "fileCount": 512, "directoryCount": 87, - "findingCount": 4, - "repoScore": 10.8, + "findingCount": 0, + "repoScore": 0, "physicalLineCount": 29677, "logicalLineCount": 20508, "functionCount": 0, "normalized": { - "scorePerFile": 0.02109375, - "scorePerKloc": 0.526623756582797, + "scorePerFile": 0, + "scorePerKloc": 0, "scorePerFunction": null, - "findingsPerFile": 0.0078125, - "findingsPerKloc": 0.1950458357714063, + "findingsPerFile": 0, + "findingsPerKloc": 0, "findingsPerFunction": null } } }, { - "id": "payload", - "repo": "payloadcms/payload", + "id": "vite", + "repo": "vitejs/vite", "cohort": "mature-oss", - "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", + "ref": "a4922537a8d705da7769d30626a0d846511fc124", "summary": { - "fileCount": 4234, - "directoryCount": 1837, - "findingCount": 21, - "repoScore": 71.2, - "physicalLineCount": 384327, - "logicalLineCount": 251992, + "fileCount": 1229, + "directoryCount": 525, + "findingCount": 0, + "repoScore": 0, + "physicalLineCount": 77629, + "logicalLineCount": 37251, "functionCount": 0, "normalized": { - "scorePerFile": 0.016816249409541805, - "scorePerKloc": 0.2825486523381695, + "scorePerFile": 0, + "scorePerKloc": 0, "scorePerFunction": null, - "findingsPerFile": 0.004959848842701937, - "findingsPerKloc": 0.08333597891996572, + "findingsPerFile": 0, + "findingsPerKloc": 0, "findingsPerFunction": null } } @@ -629,54 +629,53 @@ "rank": 2 }, { - "ruleId": "structure.pass-through-wrappers", - "ruleSlug": "pass-through-wrappers", - "family": "structure", + "ruleId": "defensive.error-swallowing", + "ruleSlug": "error-swallowing", + "family": "defensive", "severity": "strong", "scope": "file", "requires": [ - "file.functionSummaries", - "file.comments" + "file.tryCatchSummaries" ], - "signalScore": 0.6666666666666666, + "signalScore": 0.7166666666666668, "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.85, + "bestMetricAuc": 0.8666666666666667, "metricAucs": { - "scorePerFile": 0.85, - "scorePerKloc": 0.65, + "scorePerFile": 0.8666666666666667, + "scorePerKloc": 0.8, "scorePerFunction": 0.5, - "findingsPerFile": 0.85, - "findingsPerKloc": 0.65, + "findingsPerFile": 0.8666666666666667, + "findingsPerKloc": 0.7666666666666667, "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, - "hitCount": 5, - "hitRate": 0.8333333333333334, - "repoScoreMedian": 13, - "findingCountMedian": 5.5, + "hitCount": 6, + "hitRate": 1, + "repoScoreMedian": 9.1, + "findingCountMedian": 3, "medians": { - "scorePerFile": 0.08309847813833643, - "scorePerKloc": 1.1223688092403985, + "scorePerFile": 0.0695086484004286, + "scorePerKloc": 0.5267386471458326, "scorePerFunction": null, - "findingsPerFile": 0.033610611510791366, - "findingsPerKloc": 0.3520667217490039, + "findingsPerFile": 0.026748813714985456, + "findingsPerKloc": 0.24436722316785256, "findingsPerFunction": null } }, "mature-oss": { "repoCount": 5, - "hitCount": 4, - "hitRate": 0.8, - "repoScoreMedian": 41, - "findingCountMedian": 13, + "hitCount": 3, + "hitRate": 0.6, + "repoScoreMedian": 13.8, + "findingCountMedian": 6, "medians": { - "scorePerFile": 0.015625, - "scorePerKloc": 0.3900916715428126, + "scorePerFile": 0.007080554130323243, + "scorePerKloc": 0.17047981420170977, "scorePerFunction": null, - "findingsPerFile": 0.005859375, - "findingsPerKloc": 0.14628437682855472, + "findingsPerFile": 0.0035915854284248334, + "findingsPerKloc": 0.08647526807333103, "findingsPerFunction": null } } @@ -690,616 +689,44 @@ "summary": { "fileCount": 32, "directoryCount": 7, - "findingCount": 1, - "repoScore": 5, + "findingCount": 10, + "repoScore": 17.4, "physicalLineCount": 9408, "logicalLineCount": 2986, "functionCount": 0, "normalized": { - "scorePerFile": 0.15625, - "scorePerKloc": 1.6744809109176155, + "scorePerFile": 0.54375, + "scorePerKloc": 5.827193569993301, "scorePerFunction": null, - "findingsPerFile": 0.03125, - "findingsPerKloc": 0.3348961821835231, + "findingsPerFile": 0.3125, + "findingsPerKloc": 3.348961821835231, "findingsPerFunction": null } } }, { - "id": "vinext", - "repo": "cloudflare/vinext", + "id": "gstack", + "repo": "garrytan/gstack", "cohort": "explicit-ai", - "ref": "28980b01f1692b47756a6768fc5733712c290f84", - "summary": { - "fileCount": 1129, - "directoryCount": 486, - "findingCount": 29, - "repoScore": 85, - "physicalLineCount": 150365, - "logicalLineCount": 59523, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.07528786536758193, - "scorePerKloc": 1.4280194210641264, - "scorePerFunction": null, - "findingsPerFile": 0.025686448184233834, - "findingsPerKloc": 0.4872066260101137, - "findingsPerFunction": null - } - } - }, - { - "id": "hunk", - "repo": "modem-dev/hunk", - "cohort": "explicit-ai", - "ref": "b37663f3c3055f860290587865199192e15d9f35", - "summary": { - "fileCount": 166, - "directoryCount": 36, - "findingCount": 6, - "repoScore": 19, - "physicalLineCount": 32498, - "logicalLineCount": 13564, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.1144578313253012, - "scorePerKloc": 1.4007667354762607, - "scorePerFunction": null, - "findingsPerFile": 0.03614457831325301, - "findingsPerKloc": 0.4423473901503981, - "findingsPerFunction": null - } - } - }, - { - "id": "gstack", - "repo": "garrytan/gstack", - "cohort": "explicit-ai", - "ref": "6cc094cd4190e3fac65b69fb29e0c3cae7e0f214", + "ref": "6cc094cd4190e3fac65b69fb29e0c3cae7e0f214", "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 7, - "repoScore": 16, + "findingCount": 8, + "repoScore": 37.400000000000006, "physicalLineCount": 62616, - "logicalLineCount": 18958, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.09090909090909091, - "scorePerKloc": 0.8439708830045364, - "scorePerFunction": null, - "findingsPerFile": 0.03977272727272727, - "findingsPerKloc": 0.3692372613144847, - "findingsPerFunction": null - } - } - }, - { - "id": "openusage", - "repo": "robinebers/openusage", - "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", - "summary": { - "fileCount": 139, - "directoryCount": 29, - "findingCount": 5, - "repoScore": 10, - "physicalLineCount": 33794, - "logicalLineCount": 22270, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.07194244604316546, - "scorePerKloc": 0.449034575662326, - "scorePerFunction": null, - "findingsPerFile": 0.03597122302158273, - "findingsPerKloc": 0.224517287831163, - "findingsPerFunction": null - } - } - }, - { - "id": "agent-ci", - "repo": "redwoodjs/agent-ci", - "cohort": "explicit-ai", - "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", - "summary": { - "fileCount": 94, - "directoryCount": 24, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 17222, - "logicalLineCount": 8474, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } - }, - { - "id": "vite", - "repo": "vitejs/vite", - "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", - "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 25, - "repoScore": 65, - "physicalLineCount": 77629, - "logicalLineCount": 37251, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.05288852725793328, - "scorePerKloc": 1.7449195994738398, - "scorePerFunction": null, - "findingsPerFile": 0.02034174125305126, - "findingsPerKloc": 0.6711229228745538, - "findingsPerFunction": null - } - } - }, - { - "id": "astro", - "repo": "withastro/astro", - "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", - "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 24, - "repoScore": 62, - "physicalLineCount": 138854, - "logicalLineCount": 80948, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.03181118522319138, - "scorePerKloc": 0.7659238029352178, - "scorePerFunction": null, - "findingsPerFile": 0.012314007183170857, - "findingsPerKloc": 0.29648663339427783, - "findingsPerFunction": null - } - } - }, - { - "id": "umami", - "repo": "umami-software/umami", - "cohort": "mature-oss", - "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", - "summary": { - "fileCount": 512, - "directoryCount": 87, - "findingCount": 3, - "repoScore": 8, - "physicalLineCount": 29677, - "logicalLineCount": 20508, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.015625, - "scorePerKloc": 0.3900916715428126, - "scorePerFunction": null, - "findingsPerFile": 0.005859375, - "findingsPerKloc": 0.14628437682855472, - "findingsPerFunction": null - } - } - }, - { - "id": "payload", - "repo": "payloadcms/payload", - "cohort": "mature-oss", - "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", - "summary": { - "fileCount": 4234, - "directoryCount": 1837, - "findingCount": 13, - "repoScore": 41, - "physicalLineCount": 384327, - "logicalLineCount": 251992, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.009683514407179971, - "scorePerKloc": 0.16270357789136164, - "scorePerFunction": null, - "findingsPerFile": 0.0030703826169107226, - "findingsPerKloc": 0.051588939331407346, - "findingsPerFunction": null - } - } - }, - { - "id": "execa", - "repo": "sindresorhus/execa", - "cohort": "mature-oss", - "ref": "99d1741d2525eca71b986282148bbf2983356428", - "summary": { - "fileCount": 580, - "directoryCount": 46, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 35995, - "logicalLineCount": 20374, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } - } - ], - "rank": 3 - }, - { - "ruleId": "defensive.error-obscuring", - "ruleSlug": "error-obscuring", - "family": "defensive", - "severity": "strong", - "scope": "file", - "requires": [ - "file.tryCatchSummaries" - ], - "signalScore": 0.6555555555555556, - "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.8333333333333334, - "metricAucs": { - "scorePerFile": 0.8, - "scorePerKloc": 0.6, - "scorePerFunction": 0.5, - "findingsPerFile": 0.8333333333333334, - "findingsPerKloc": 0.7, - "findingsPerFunction": 0.5 - }, - "cohorts": { - "explicit-ai": { - "repoCount": 6, - "hitCount": 5, - "hitRate": 0.8333333333333334, - "repoScoreMedian": 9.4, - "findingCountMedian": 4.5, - "medians": { - "scorePerFile": 0.06158622769161187, - "scorePerKloc": 0.8214329438453718, - "scorePerFunction": null, - "findingsPerFile": 0.026586321919228086, - "findingsPerKloc": 0.37861477861579207, - "findingsPerFunction": null - } - }, - "mature-oss": { - "repoCount": 5, - "hitCount": 5, - "hitRate": 1, - "repoScoreMedian": 14.4, - "findingCountMedian": 5, - "medians": { - "scorePerFile": 0.018233349078885217, - "scorePerKloc": 0.38656680357574297, - "scorePerFunction": null, - "findingsPerFile": 0.006613131790269249, - "findingsPerKloc": 0.13422458457491074, - "findingsPerFunction": null - } - } - }, - "repos": [ - { - "id": "gstack", - "repo": "garrytan/gstack", - "cohort": "explicit-ai", - "ref": "6cc094cd4190e3fac65b69fb29e0c3cae7e0f214", - "summary": { - "fileCount": 176, - "directoryCount": 19, - "findingCount": 19, - "repoScore": 49.40000000000002, - "physicalLineCount": 62616, - "logicalLineCount": 18958, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.2806818181818183, - "scorePerKloc": 2.6057601012765073, - "scorePerFunction": null, - "findingsPerFile": 0.10795454545454546, - "findingsPerKloc": 1.002215423567887, - "findingsPerFunction": null - } - } - }, - { - "id": "vinext", - "repo": "cloudflare/vinext", - "cohort": "explicit-ai", - "ref": "28980b01f1692b47756a6768fc5733712c290f84", - "summary": { - "fileCount": 1129, - "directoryCount": 486, - "findingCount": 24, - "repoScore": 69.40000000000002, - "physicalLineCount": 150365, - "logicalLineCount": 59523, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.061470327723649264, - "scorePerKloc": 1.1659358567276519, - "scorePerFunction": null, - "findingsPerFile": 0.021257750221434897, - "findingsPerKloc": 0.40320548359457686, - "findingsPerFunction": null - } - } - }, - { - "id": "hunk", - "repo": "modem-dev/hunk", - "cohort": "explicit-ai", - "ref": "b37663f3c3055f860290587865199192e15d9f35", - "summary": { - "fileCount": 166, - "directoryCount": 36, - "findingCount": 6, - "repoScore": 13, - "physicalLineCount": 32498, - "logicalLineCount": 13564, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.0783132530120482, - "scorePerKloc": 0.9584193453258626, - "scorePerFunction": null, - "findingsPerFile": 0.03614457831325301, - "findingsPerKloc": 0.4423473901503981, - "findingsPerFunction": null - } - } - }, - { - "id": "agent-ci", - "repo": "redwoodjs/agent-ci", - "cohort": "explicit-ai", - "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", - "summary": { - "fileCount": 94, - "directoryCount": 24, - "findingCount": 3, - "repoScore": 5.800000000000001, - "physicalLineCount": 17222, - "logicalLineCount": 8474, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.061702127659574474, - "scorePerKloc": 0.6844465423648809, - "scorePerFunction": null, - "findingsPerFile": 0.031914893617021274, - "findingsPerKloc": 0.35402407363700733, - "findingsPerFunction": null - } - } - }, - { - "id": "openusage", - "repo": "robinebers/openusage", - "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", - "summary": { - "fileCount": 139, - "directoryCount": 29, - "findingCount": 2, - "repoScore": 4.2, - "physicalLineCount": 33794, - "logicalLineCount": 22270, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.030215827338129497, - "scorePerKloc": 0.18859452177817693, - "scorePerFunction": null, - "findingsPerFile": 0.014388489208633094, - "findingsPerKloc": 0.0898069151324652, - "findingsPerFunction": null - } - } - }, - { - "id": "devworkbench", - "repo": "jiayun/DevWorkbench", - "cohort": "explicit-ai", - "ref": "ea50862107c377b0cdd6e508073ad0330b367576", - "summary": { - "fileCount": 32, - "directoryCount": 7, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 9408, - "logicalLineCount": 2986, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } - }, - { - "id": "astro", - "repo": "withastro/astro", - "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", - "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 26, - "repoScore": 80.7, - "physicalLineCount": 138854, - "logicalLineCount": 80948, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.04140584915341201, - "scorePerKloc": 0.9969363047882592, - "scorePerFunction": null, - "findingsPerFile": 0.013340174448435094, - "findingsPerKloc": 0.321193852843801, - "findingsPerFunction": null - } - } - }, - { - "id": "umami", - "repo": "umami-software/umami", - "cohort": "mature-oss", - "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", - "summary": { - "fileCount": 512, - "directoryCount": 87, - "findingCount": 4, - "repoScore": 11.5, - "physicalLineCount": 29677, - "logicalLineCount": 20508, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.0224609375, - "scorePerKloc": 0.5607567778427931, - "scorePerFunction": null, - "findingsPerFile": 0.0078125, - "findingsPerKloc": 0.1950458357714063, - "findingsPerFunction": null - } - } - }, - { - "id": "vite", - "repo": "vitejs/vite", - "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", - "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 5, - "repoScore": 14.4, - "physicalLineCount": 77629, - "logicalLineCount": 37251, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.011716842961757526, - "scorePerKloc": 0.38656680357574297, - "scorePerFunction": null, - "findingsPerFile": 0.0040683482506102524, - "findingsPerKloc": 0.13422458457491074, - "findingsPerFunction": null - } - } - }, - { - "id": "payload", - "repo": "payloadcms/payload", - "cohort": "mature-oss", - "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", - "summary": { - "fileCount": 4234, - "directoryCount": 1837, - "findingCount": 28, - "repoScore": 77.2, - "physicalLineCount": 384327, - "logicalLineCount": 251992, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.018233349078885217, - "scorePerKloc": 0.30635893202958825, - "scorePerFunction": null, - "findingsPerFile": 0.006613131790269249, - "findingsPerKloc": 0.11111463855995429, - "findingsPerFunction": null - } - } - }, - { - "id": "execa", - "repo": "sindresorhus/execa", - "cohort": "mature-oss", - "ref": "99d1741d2525eca71b986282148bbf2983356428", - "summary": { - "fileCount": 580, - "directoryCount": 46, - "findingCount": 1, - "repoScore": 5, - "physicalLineCount": 35995, - "logicalLineCount": 20374, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.008620689655172414, - "scorePerKloc": 0.24541081770884463, - "scorePerFunction": null, - "findingsPerFile": 0.0017241379310344827, - "findingsPerKloc": 0.049082163541768926, - "findingsPerFunction": null - } - } - } - ], - "rank": 4 - }, - { - "ruleId": "tests.duplicate-mock-setup", - "ruleSlug": "duplicate-mock-setup", - "family": "tests", - "severity": "medium", - "scope": "file", - "requires": [ - "repo.testMockDuplication" - ], - "signalScore": 0.6333333333333333, - "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.7, - "metricAucs": { - "scorePerFile": 0.7, - "scorePerKloc": 0.7, - "scorePerFunction": 0.5, - "findingsPerFile": 0.7, - "findingsPerKloc": 0.7, - "findingsPerFunction": 0.5 - }, - "cohorts": { - "explicit-ai": { - "repoCount": 6, - "hitCount": 3, - "hitRate": 0.5, - "repoScoreMedian": 4.5, - "findingCountMedian": 1.5, - "medians": { - "scorePerFile": 0.03985828166519043, - "scorePerKloc": 0.5310361104555109, - "scorePerFunction": null, - "findingsPerFile": 0.007971656333038087, - "findingsPerKloc": 0.15120205634796632, - "findingsPerFunction": null - } - }, - "mature-oss": { - "repoCount": 5, - "hitCount": 1, - "hitRate": 0.2, - "repoScoreMedian": 0, - "findingCountMedian": 0, - "medians": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null + "logicalLineCount": 18958, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.21250000000000002, + "scorePerKloc": 1.972781939023104, + "scorePerFunction": null, + "findingsPerFile": 0.045454545454545456, + "findingsPerKloc": 0.4219854415022682, + "findingsPerFunction": null + } } - } - }, - "repos": [ + }, { "id": "openusage", "repo": "robinebers/openusage", @@ -1308,40 +735,17 @@ "summary": { "fileCount": 139, "directoryCount": 29, - "findingCount": 25, - "repoScore": 112, + "findingCount": 3, + "repoScore": 14, "physicalLineCount": 33794, "logicalLineCount": 22270, "functionCount": 0, "normalized": { - "scorePerFile": 0.8057553956834532, - "scorePerKloc": 5.029187247418052, - "scorePerFunction": null, - "findingsPerFile": 0.17985611510791366, - "findingsPerKloc": 1.1225864391558151, - "findingsPerFunction": null - } - } - }, - { - "id": "vinext", - "repo": "cloudflare/vinext", - "cohort": "explicit-ai", - "ref": "28980b01f1692b47756a6768fc5733712c290f84", - "summary": { - "fileCount": 1129, - "directoryCount": 486, - "findingCount": 18, - "repoScore": 90, - "physicalLineCount": 150365, - "logicalLineCount": 59523, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.07971656333038087, - "scorePerKloc": 1.5120205634796633, + "scorePerFile": 0.10071942446043165, + "scorePerKloc": 0.6286484059272565, "scorePerFunction": null, - "findingsPerFile": 0.015943312666076175, - "findingsPerKloc": 0.30240411269593265, + "findingsPerFile": 0.02158273381294964, + "findingsPerKloc": 0.1347103726986978, "findingsPerFunction": null } } @@ -1355,13 +759,13 @@ "fileCount": 94, "directoryCount": 24, "findingCount": 3, - "repoScore": 9, + "repoScore": 3.6000000000000005, "physicalLineCount": 17222, "logicalLineCount": 8474, "functionCount": 0, "normalized": { - "scorePerFile": 0.09574468085106383, - "scorePerKloc": 1.0620722209110218, + "scorePerFile": 0.03829787234042554, + "scorePerKloc": 0.42482888836440885, "scorePerFunction": null, "findingsPerFile": 0.031914893617021274, "findingsPerKloc": 0.35402407363700733, @@ -1370,70 +774,70 @@ } }, { - "id": "gstack", - "repo": "garrytan/gstack", + "id": "hunk", + "repo": "modem-dev/hunk", "cohort": "explicit-ai", - "ref": "6cc094cd4190e3fac65b69fb29e0c3cae7e0f214", + "ref": "b37663f3c3055f860290587865199192e15d9f35", "summary": { - "fileCount": 176, - "directoryCount": 19, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 62616, - "logicalLineCount": 18958, + "fileCount": 166, + "directoryCount": 36, + "findingCount": 1, + "repoScore": 3, + "physicalLineCount": 32498, + "logicalLineCount": 13564, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.018072289156626505, + "scorePerKloc": 0.22117369507519904, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.006024096385542169, + "findingsPerKloc": 0.07372456502506636, "findingsPerFunction": null } } }, { - "id": "devworkbench", - "repo": "jiayun/DevWorkbench", + "id": "vinext", + "repo": "cloudflare/vinext", "cohort": "explicit-ai", - "ref": "ea50862107c377b0cdd6e508073ad0330b367576", + "ref": "28980b01f1692b47756a6768fc5733712c290f84", "summary": { - "fileCount": 32, - "directoryCount": 7, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 9408, - "logicalLineCount": 2986, + "fileCount": 1129, + "directoryCount": 486, + "findingCount": 2, + "repoScore": 4.2, + "physicalLineCount": 150365, + "logicalLineCount": 59523, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.003720106288751107, + "scorePerKloc": 0.07056095962905096, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.001771479185119575, + "findingsPerKloc": 0.03360045696621474, "findingsPerFunction": null } } }, { - "id": "hunk", - "repo": "modem-dev/hunk", - "cohort": "explicit-ai", - "ref": "b37663f3c3055f860290587865199192e15d9f35", + "id": "vite", + "repo": "vitejs/vite", + "cohort": "mature-oss", + "ref": "a4922537a8d705da7769d30626a0d846511fc124", "summary": { - "fileCount": 166, - "directoryCount": 36, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 32498, - "logicalLineCount": 13564, + "fileCount": 1229, + "directoryCount": 525, + "findingCount": 6, + "repoScore": 19.2, + "physicalLineCount": 77629, + "logicalLineCount": 37251, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.015622457282343368, + "scorePerKloc": 0.5154224047676572, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.004882017900732303, + "findingsPerKloc": 0.1610695014898929, "findingsPerFunction": null } } @@ -1446,17 +850,40 @@ "summary": { "fileCount": 4234, "directoryCount": 1837, - "findingCount": 6, - "repoScore": 22.5, + "findingCount": 29, + "repoScore": 84.80000000000001, "physicalLineCount": 384327, "logicalLineCount": 251992, "functionCount": 0, "normalized": { - "scorePerFile": 0.005314123760037789, - "scorePerKloc": 0.0892885488428204, + "scorePerFile": 0.02002834199338687, + "scorePerKloc": 0.33651861963871876, "scorePerFunction": null, - "findingsPerFile": 0.0014170996693434106, - "findingsPerKloc": 0.023810279691418777, + "findingsPerFile": 0.00684931506849315, + "findingsPerKloc": 0.11508301850852408, + "findingsPerFunction": null + } + } + }, + { + "id": "astro", + "repo": "withastro/astro", + "cohort": "mature-oss", + "ref": "f7068995aa451dced13853789b0d51433c2373b5", + "summary": { + "fileCount": 1949, + "directoryCount": 852, + "findingCount": 7, + "repoScore": 13.8, + "physicalLineCount": 138854, + "logicalLineCount": 80948, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.007080554130323243, + "scorePerKloc": 0.17047981420170977, + "scorePerFunction": null, + "findingsPerFile": 0.0035915854284248334, + "findingsPerKloc": 0.08647526807333103, "findingsPerFunction": null } } @@ -1506,81 +933,50 @@ "findingsPerFunction": null } } - }, - { - "id": "vite", - "repo": "vitejs/vite", - "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", - "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 77629, - "logicalLineCount": 37251, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } - }, - { - "id": "astro", - "repo": "withastro/astro", - "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", - "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 138854, - "logicalLineCount": 80948, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } } ], - "rank": 5 + "rank": 3 }, { - "ruleId": "comments.placeholder-comments", - "ruleSlug": "placeholder-comments", - "family": "comments", - "severity": "weak", + "ruleId": "defensive.stringified-unknown-errors", + "ruleSlug": "stringified-unknown-errors", + "family": "defensive", + "severity": "strong", "scope": "file", "requires": [ - "file.comments" + "file.ast" ], - "signalScore": 0.5, + "signalScore": 0.7000000000000001, "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.5, + "bestMetricAuc": 0.8, "metricAucs": { - "scorePerFile": 0.5, - "scorePerKloc": 0.5, + "scorePerFile": 0.8, + "scorePerKloc": 0.8, "scorePerFunction": 0.5, - "findingsPerFile": 0.5, - "findingsPerKloc": 0.5, + "findingsPerFile": 0.8, + "findingsPerKloc": 0.8, "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, - "hitCount": 0, - "hitRate": 0, + "hitCount": 4, + "hitRate": 0.6666666666666666, + "repoScoreMedian": 5, + "findingCountMedian": 1.5, + "medians": { + "scorePerFile": 0.025334286659481148, + "scorePerKloc": 0.3056936706134833, + "scorePerFunction": null, + "findingsPerFile": 0.007712476849987921, + "findingsPerKloc": 0.10009865511895812, + "findingsPerFunction": null + } + }, + "mature-oss": { + "repoCount": 5, + "hitCount": 1, + "hitRate": 0.2, "repoScoreMedian": 0, "findingCountMedian": 0, "medians": { @@ -1591,24 +987,32 @@ "findingsPerKloc": 0, "findingsPerFunction": null } + } + }, + "repos": [ + { + "id": "devworkbench", + "repo": "jiayun/DevWorkbench", + "cohort": "explicit-ai", + "ref": "ea50862107c377b0cdd6e508073ad0330b367576", + "summary": { + "fileCount": 32, + "directoryCount": 7, + "findingCount": 2, + "repoScore": 8, + "physicalLineCount": 9408, + "logicalLineCount": 2986, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.25, + "scorePerKloc": 2.6791694574681846, + "scorePerFunction": null, + "findingsPerFile": 0.0625, + "findingsPerKloc": 0.6697923643670461, + "findingsPerFunction": null + } + } }, - "mature-oss": { - "repoCount": 5, - "hitCount": 0, - "hitRate": 0, - "repoScoreMedian": 0, - "findingCountMedian": 0, - "medians": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } - }, - "repos": [ { "id": "vinext", "repo": "cloudflare/vinext", @@ -1617,17 +1021,17 @@ "summary": { "fileCount": 1129, "directoryCount": 486, - "findingCount": 0, - "repoScore": 0, + "findingCount": 11, + "repoScore": 30, "physicalLineCount": 150365, "logicalLineCount": 59523, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.026572187776793623, + "scorePerKloc": 0.5040068544932211, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.00974313551815766, + "findingsPerKloc": 0.18480251331418107, "findingsPerFunction": null } } @@ -1640,40 +1044,17 @@ "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 0, - "repoScore": 0, + "findingCount": 1, + "repoScore": 6, "physicalLineCount": 62616, "logicalLineCount": 18958, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } - }, - { - "id": "devworkbench", - "repo": "jiayun/DevWorkbench", - "cohort": "explicit-ai", - "ref": "ea50862107c377b0cdd6e508073ad0330b367576", - "summary": { - "fileCount": 32, - "directoryCount": 7, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 9408, - "logicalLineCount": 2986, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.03409090909090909, + "scorePerKloc": 0.31648908112670116, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.005681818181818182, + "findingsPerKloc": 0.052748180187783524, "findingsPerFunction": null } } @@ -1686,17 +1067,17 @@ "summary": { "fileCount": 166, "directoryCount": 36, - "findingCount": 0, - "repoScore": 0, + "findingCount": 2, + "repoScore": 4, "physicalLineCount": 32498, "logicalLineCount": 13564, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.024096385542168676, + "scorePerKloc": 0.29489826010026543, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.012048192771084338, + "findingsPerKloc": 0.14744913005013272, "findingsPerFunction": null } } @@ -1747,6 +1128,29 @@ } } }, + { + "id": "astro", + "repo": "withastro/astro", + "cohort": "mature-oss", + "ref": "f7068995aa451dced13853789b0d51433c2373b5", + "summary": { + "fileCount": 1949, + "directoryCount": 852, + "findingCount": 1, + "repoScore": 2, + "physicalLineCount": 138854, + "logicalLineCount": 80948, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.001026167265264238, + "scorePerKloc": 0.024707219449523154, + "scorePerFunction": null, + "findingsPerFile": 0.000513083632632119, + "findingsPerKloc": 0.012353609724761577, + "findingsPerFunction": null + } + } + }, { "id": "payload", "repo": "payloadcms/payload", @@ -1838,81 +1242,58 @@ "findingsPerFunction": null } } - }, - { - "id": "astro", - "repo": "withastro/astro", - "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", - "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 138854, - "logicalLineCount": 80948, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": null - } - } } ], - "rank": 6 + "rank": 4 }, { - "ruleId": "defensive.async-noise", - "ruleSlug": "async-noise", + "ruleId": "defensive.empty-catch", + "ruleSlug": "empty-catch", "family": "defensive", - "severity": "medium", + "severity": "strong", "scope": "file", "requires": [ - "file.functionSummaries" + "file.tryCatchSummaries" ], - "signalScore": 0.41111111111111115, - "bestMetric": "findingsPerFunction", - "bestMetricAuc": 0.5, + "signalScore": 0.6666666666666666, + "bestMetric": "findingsPerFile", + "bestMetricAuc": 0.9333333333333333, "metricAucs": { - "scorePerFile": 0.4166666666666667, - "scorePerKloc": 0.35, + "scorePerFile": 0.8666666666666667, + "scorePerKloc": 0.6333333333333333, "scorePerFunction": 0.5, - "findingsPerFile": 0.4166666666666667, - "findingsPerKloc": 0.2833333333333333, + "findingsPerFile": 0.9333333333333333, + "findingsPerKloc": 0.5666666666666667, "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, - "hitCount": 3, - "hitRate": 0.5, - "repoScoreMedian": 0.375, - "findingCountMedian": 0.5, + "hitCount": 6, + "hitRate": 1, + "repoScoreMedian": 42.3, + "findingCountMedian": 10, "medians": { - "scorePerFile": 0.002259036144578313, - "scorePerKloc": 0.02764671188439988, + "scorePerFile": 0.11837132703475772, + "scorePerKloc": 1.2343535610214642, "scorePerFunction": null, - "findingsPerFile": 0.001771479185119575, - "findingsPerKloc": 0.03360045696621474, + "findingsPerFile": 0.030013489208633094, + "findingsPerKloc": 0.3148972211418942, "findingsPerFunction": null } }, "mature-oss": { "repoCount": 5, - "hitCount": 4, - "hitRate": 0.8, - "repoScoreMedian": 9, - "findingCountMedian": 6, + "hitCount": 5, + "hitRate": 1, + "repoScoreMedian": 45.1, + "findingCountMedian": 13, "medians": { - "scorePerFile": 0.0029296875, - "scorePerKloc": 0.07314218841427736, + "scorePerFile": 0.036696501220504475, + "scorePerKloc": 1.210705752865695, "scorePerFunction": null, - "findingsPerFile": 0.00390625, - "findingsPerKloc": 0.09752291788570315, + "findingsPerFile": 0.010577705451586655, + "findingsPerKloc": 0.34898391989476796, "findingsPerFunction": null } } @@ -1926,40 +1307,40 @@ "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 2, - "repoScore": 4.5, + "findingCount": 55, + "repoScore": 301.3, "physicalLineCount": 62616, "logicalLineCount": 18958, "functionCount": 0, "normalized": { - "scorePerFile": 0.02556818181818182, - "scorePerKloc": 0.23736681084502587, + "scorePerFile": 1.7119318181818182, + "scorePerKloc": 15.893026690579177, "scorePerFunction": null, - "findingsPerFile": 0.011363636363636364, - "findingsPerKloc": 0.10549636037556705, + "findingsPerFile": 0.3125, + "findingsPerKloc": 2.901149910328094, "findingsPerFunction": null } } }, { - "id": "vinext", - "repo": "cloudflare/vinext", + "id": "agent-ci", + "repo": "redwoodjs/agent-ci", "cohort": "explicit-ai", - "ref": "28980b01f1692b47756a6768fc5733712c290f84", + "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", "summary": { - "fileCount": 1129, - "directoryCount": 486, - "findingCount": 4, - "repoScore": 6, - "physicalLineCount": 150365, - "logicalLineCount": 59523, + "fileCount": 94, + "directoryCount": 24, + "findingCount": 18, + "repoScore": 69.3, + "physicalLineCount": 17222, + "logicalLineCount": 8474, "functionCount": 0, "normalized": { - "scorePerFile": 0.005314437555358724, - "scorePerKloc": 0.10080137089864422, + "scorePerFile": 0.7372340425531915, + "scorePerKloc": 8.17795610101487, "scorePerFunction": null, - "findingsPerFile": 0.00354295837023915, - "findingsPerKloc": 0.06720091393242948, + "findingsPerFile": 0.19148936170212766, + "findingsPerKloc": 2.1241444418220436, "findingsPerFunction": null } } @@ -1972,109 +1353,109 @@ "summary": { "fileCount": 166, "directoryCount": 36, - "findingCount": 1, - "repoScore": 0.75, + "findingCount": 4, + "repoScore": 18.4, "physicalLineCount": 32498, "logicalLineCount": 13564, "functionCount": 0, "normalized": { - "scorePerFile": 0.004518072289156626, - "scorePerKloc": 0.05529342376879976, + "scorePerFile": 0.1108433734939759, + "scorePerKloc": 1.3565319964612208, "scorePerFunction": null, - "findingsPerFile": 0.006024096385542169, - "findingsPerKloc": 0.07372456502506636, + "findingsPerFile": 0.024096385542168676, + "findingsPerKloc": 0.29489826010026543, "findingsPerFunction": null } } }, { - "id": "devworkbench", - "repo": "jiayun/DevWorkbench", + "id": "vinext", + "repo": "cloudflare/vinext", "cohort": "explicit-ai", - "ref": "ea50862107c377b0cdd6e508073ad0330b367576", + "ref": "28980b01f1692b47756a6768fc5733712c290f84", "summary": { - "fileCount": 32, - "directoryCount": 7, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 9408, - "logicalLineCount": 2986, + "fileCount": 1129, + "directoryCount": 486, + "findingCount": 16, + "repoScore": 66.19999999999999, + "physicalLineCount": 150365, + "logicalLineCount": 59523, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.05863596102745792, + "scorePerKloc": 1.1121751255817076, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.0141718334809566, + "findingsPerKloc": 0.2688036557297179, "findingsPerFunction": null } } }, { - "id": "agent-ci", - "repo": "redwoodjs/agent-ci", + "id": "openusage", + "repo": "robinebers/openusage", "cohort": "explicit-ai", - "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", + "ref": "857f537a243483acf98ccd9ea32e20b380c63823", "summary": { - "fileCount": 94, - "directoryCount": 24, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 17222, - "logicalLineCount": 8474, + "fileCount": 139, + "directoryCount": 29, + "findingCount": 4, + "repoScore": 17.5, + "physicalLineCount": 33794, + "logicalLineCount": 22270, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.12589928057553956, + "scorePerKloc": 0.7858105074090705, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.02877697841726619, + "findingsPerKloc": 0.1796138302649304, "findingsPerFunction": null } } }, { - "id": "openusage", - "repo": "robinebers/openusage", + "id": "devworkbench", + "repo": "jiayun/DevWorkbench", "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "ref": "ea50862107c377b0cdd6e508073ad0330b367576", "summary": { - "fileCount": 139, - "directoryCount": 29, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 33794, - "logicalLineCount": 22270, + "fileCount": 32, + "directoryCount": 7, + "findingCount": 1, + "repoScore": 1.9000000000000001, + "physicalLineCount": 9408, + "logicalLineCount": 2986, "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "normalized": { + "scorePerFile": 0.059375000000000004, + "scorePerKloc": 0.6363027461486939, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.03125, + "findingsPerKloc": 0.3348961821835231, "findingsPerFunction": null } } }, { - "id": "vite", - "repo": "vitejs/vite", + "id": "execa", + "repo": "sindresorhus/execa", "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", + "ref": "99d1741d2525eca71b986282148bbf2983356428", "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 8, - "repoScore": 11.25, - "physicalLineCount": 77629, - "logicalLineCount": 37251, + "fileCount": 580, + "directoryCount": 46, + "findingCount": 11, + "repoScore": 43.9, + "physicalLineCount": 35995, + "logicalLineCount": 20374, "functionCount": 0, "normalized": { - "scorePerFile": 0.009153783563873067, - "scorePerKloc": 0.3020053152935492, + "scorePerFile": 0.07568965517241379, + "scorePerKloc": 2.1547069794836555, "scorePerFunction": null, - "findingsPerFile": 0.006509357200976403, - "findingsPerKloc": 0.2147593353198572, + "findingsPerFile": 0.01896551724137931, + "findingsPerKloc": 0.5399037989594582, "findingsPerFunction": null } } @@ -2087,17 +1468,40 @@ "summary": { "fileCount": 1949, "directoryCount": 852, - "findingCount": 11, - "repoScore": 18, + "findingCount": 39, + "repoScore": 133.90000000000006, "physicalLineCount": 138854, "logicalLineCount": 80948, "functionCount": 0, "normalized": { - "scorePerFile": 0.009235505387378143, - "scorePerKloc": 0.22236497504570837, + "scorePerFile": 0.06870189840944077, + "scorePerKloc": 1.6541483421455758, + "scorePerFunction": null, + "findingsPerFile": 0.020010261672652643, + "findingsPerKloc": 0.48179077926570146, + "findingsPerFunction": null + } + } + }, + { + "id": "vite", + "repo": "vitejs/vite", + "cohort": "mature-oss", + "ref": "a4922537a8d705da7769d30626a0d846511fc124", + "summary": { + "fileCount": 1229, + "directoryCount": 525, + "findingCount": 13, + "repoScore": 45.1, + "physicalLineCount": 77629, + "logicalLineCount": 37251, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.036696501220504475, + "scorePerKloc": 1.210705752865695, "scorePerFunction": null, - "findingsPerFile": 0.005643919958953309, - "findingsPerKloc": 0.13588970697237734, + "findingsPerFile": 0.010577705451586655, + "findingsPerKloc": 0.34898391989476796, "findingsPerFunction": null } } @@ -2110,17 +1514,17 @@ "summary": { "fileCount": 512, "directoryCount": 87, - "findingCount": 2, - "repoScore": 1.5, + "findingCount": 4, + "repoScore": 10.8, "physicalLineCount": 29677, "logicalLineCount": 20508, "functionCount": 0, "normalized": { - "scorePerFile": 0.0029296875, - "scorePerKloc": 0.07314218841427736, + "scorePerFile": 0.02109375, + "scorePerKloc": 0.526623756582797, "scorePerFunction": null, - "findingsPerFile": 0.00390625, - "findingsPerKloc": 0.09752291788570315, + "findingsPerFile": 0.0078125, + "findingsPerKloc": 0.1950458357714063, "findingsPerFunction": null } } @@ -2133,94 +1537,72 @@ "summary": { "fileCount": 4234, "directoryCount": 1837, - "findingCount": 6, - "repoScore": 9, + "findingCount": 21, + "repoScore": 71.2, "physicalLineCount": 384327, "logicalLineCount": 251992, "functionCount": 0, "normalized": { - "scorePerFile": 0.0021256495040151155, - "scorePerKloc": 0.03571541953712817, - "scorePerFunction": null, - "findingsPerFile": 0.0014170996693434106, - "findingsPerKloc": 0.023810279691418777, - "findingsPerFunction": null - } - } - }, - { - "id": "execa", - "repo": "sindresorhus/execa", - "cohort": "mature-oss", - "ref": "99d1741d2525eca71b986282148bbf2983356428", - "summary": { - "fileCount": 580, - "directoryCount": 46, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 35995, - "logicalLineCount": 20374, - "functionCount": 0, - "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.016816249409541805, + "scorePerKloc": 0.2825486523381695, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.004959848842701937, + "findingsPerKloc": 0.08333597891996572, "findingsPerFunction": null } } } ], - "rank": 7 + "rank": 5 }, { - "ruleId": "structure.barrel-density", - "ruleSlug": "barrel-density", + "ruleId": "structure.pass-through-wrappers", + "ruleSlug": "pass-through-wrappers", "family": "structure", - "severity": "medium", + "severity": "strong", "scope": "file", "requires": [ - "file.exportSummary" + "file.functionSummaries", + "file.comments" ], - "signalScore": 0.3499999999999999, - "bestMetric": "findingsPerFunction", - "bestMetricAuc": 0.5, + "signalScore": 0.6666666666666666, + "bestMetric": "findingsPerFile", + "bestMetricAuc": 0.85, "metricAucs": { - "scorePerFile": 0.3333333333333333, - "scorePerKloc": 0.2, + "scorePerFile": 0.85, + "scorePerKloc": 0.65, "scorePerFunction": 0.5, - "findingsPerFile": 0.3333333333333333, - "findingsPerKloc": 0.23333333333333334, + "findingsPerFile": 0.85, + "findingsPerKloc": 0.65, "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, - "hitCount": 3, - "hitRate": 0.5, - "repoScoreMedian": 1, - "findingCountMedian": 0.5, + "hitCount": 5, + "hitRate": 0.8333333333333334, + "repoScoreMedian": 13, + "findingCountMedian": 5.5, "medians": { - "scorePerFile": 0.003100088573959256, - "scorePerKloc": 0.058800799690875795, + "scorePerFile": 0.08309847813833643, + "scorePerKloc": 1.1223688092403985, "scorePerFunction": null, - "findingsPerFile": 0.001328609388839681, - "findingsPerKloc": 0.025200342724661054, + "findingsPerFile": 0.033610611510791366, + "findingsPerKloc": 0.3520667217490039, "findingsPerFunction": null } }, "mature-oss": { "repoCount": 5, - "hitCount": 5, - "hitRate": 1, - "repoScoreMedian": 19, - "findingCountMedian": 8, + "hitCount": 4, + "hitRate": 0.8, + "repoScoreMedian": 41, + "findingCountMedian": 13, "medians": { - "scorePerFile": 0.017578125, - "scorePerKloc": 0.43885313048566416, + "scorePerFile": 0.015625, + "scorePerKloc": 0.3900916715428126, "scorePerFunction": null, - "findingsPerFile": 0.006509357200976403, + "findingsPerFile": 0.005859375, "findingsPerKloc": 0.14628437682855472, "findingsPerFunction": null } @@ -2236,13 +1618,13 @@ "fileCount": 32, "directoryCount": 7, "findingCount": 1, - "repoScore": 3, + "repoScore": 5, "physicalLineCount": 9408, "logicalLineCount": 2986, "functionCount": 0, "normalized": { - "scorePerFile": 0.09375, - "scorePerKloc": 1.0046885465505693, + "scorePerFile": 0.15625, + "scorePerKloc": 1.6744809109176155, "scorePerFunction": null, "findingsPerFile": 0.03125, "findingsPerKloc": 0.3348961821835231, @@ -2251,47 +1633,47 @@ } }, { - "id": "agent-ci", - "repo": "redwoodjs/agent-ci", + "id": "vinext", + "repo": "cloudflare/vinext", "cohort": "explicit-ai", - "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", + "ref": "28980b01f1692b47756a6768fc5733712c290f84", "summary": { - "fileCount": 94, - "directoryCount": 24, - "findingCount": 1, - "repoScore": 2, - "physicalLineCount": 17222, - "logicalLineCount": 8474, + "fileCount": 1129, + "directoryCount": 486, + "findingCount": 29, + "repoScore": 85, + "physicalLineCount": 150365, + "logicalLineCount": 59523, "functionCount": 0, "normalized": { - "scorePerFile": 0.02127659574468085, - "scorePerKloc": 0.2360160490913382, + "scorePerFile": 0.07528786536758193, + "scorePerKloc": 1.4280194210641264, "scorePerFunction": null, - "findingsPerFile": 0.010638297872340425, - "findingsPerKloc": 0.1180080245456691, + "findingsPerFile": 0.025686448184233834, + "findingsPerKloc": 0.4872066260101137, "findingsPerFunction": null } } }, { - "id": "vinext", - "repo": "cloudflare/vinext", + "id": "hunk", + "repo": "modem-dev/hunk", "cohort": "explicit-ai", - "ref": "28980b01f1692b47756a6768fc5733712c290f84", + "ref": "b37663f3c3055f860290587865199192e15d9f35", "summary": { - "fileCount": 1129, - "directoryCount": 486, - "findingCount": 3, - "repoScore": 7, - "physicalLineCount": 150365, - "logicalLineCount": 59523, + "fileCount": 166, + "directoryCount": 36, + "findingCount": 6, + "repoScore": 19, + "physicalLineCount": 32498, + "logicalLineCount": 13564, "functionCount": 0, "normalized": { - "scorePerFile": 0.006200177147918512, - "scorePerKloc": 0.11760159938175159, + "scorePerFile": 0.1144578313253012, + "scorePerKloc": 1.4007667354762607, "scorePerFunction": null, - "findingsPerFile": 0.002657218777679362, - "findingsPerKloc": 0.05040068544932211, + "findingsPerFile": 0.03614457831325301, + "findingsPerKloc": 0.4423473901503981, "findingsPerFunction": null } } @@ -2304,33 +1686,56 @@ "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 0, - "repoScore": 0, + "findingCount": 7, + "repoScore": 16, "physicalLineCount": 62616, "logicalLineCount": 18958, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.09090909090909091, + "scorePerKloc": 0.8439708830045364, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.03977272727272727, + "findingsPerKloc": 0.3692372613144847, "findingsPerFunction": null } } }, { - "id": "hunk", - "repo": "modem-dev/hunk", + "id": "openusage", + "repo": "robinebers/openusage", "cohort": "explicit-ai", - "ref": "b37663f3c3055f860290587865199192e15d9f35", + "ref": "857f537a243483acf98ccd9ea32e20b380c63823", "summary": { - "fileCount": 166, - "directoryCount": 36, + "fileCount": 139, + "directoryCount": 29, + "findingCount": 5, + "repoScore": 10, + "physicalLineCount": 33794, + "logicalLineCount": 22270, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.07194244604316546, + "scorePerKloc": 0.449034575662326, + "scorePerFunction": null, + "findingsPerFile": 0.03597122302158273, + "findingsPerKloc": 0.224517287831163, + "findingsPerFunction": null + } + } + }, + { + "id": "agent-ci", + "repo": "redwoodjs/agent-ci", + "cohort": "explicit-ai", + "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", + "summary": { + "fileCount": 94, + "directoryCount": 24, "findingCount": 0, "repoScore": 0, - "physicalLineCount": 32498, - "logicalLineCount": 13564, + "physicalLineCount": 17222, + "logicalLineCount": 8474, "functionCount": 0, "normalized": { "scorePerFile": 0, @@ -2343,24 +1748,24 @@ } }, { - "id": "openusage", - "repo": "robinebers/openusage", - "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "id": "vite", + "repo": "vitejs/vite", + "cohort": "mature-oss", + "ref": "a4922537a8d705da7769d30626a0d846511fc124", "summary": { - "fileCount": 139, - "directoryCount": 29, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 33794, - "logicalLineCount": 22270, + "fileCount": 1229, + "directoryCount": 525, + "findingCount": 25, + "repoScore": 65, + "physicalLineCount": 77629, + "logicalLineCount": 37251, "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, + "scorePerFile": 0.05288852725793328, + "scorePerKloc": 1.7449195994738398, "scorePerFunction": null, - "findingsPerFile": 0, - "findingsPerKloc": 0, + "findingsPerFile": 0.02034174125305126, + "findingsPerKloc": 0.6711229228745538, "findingsPerFunction": null } } @@ -2373,40 +1778,17 @@ "summary": { "fileCount": 1949, "directoryCount": 852, - "findingCount": 27, - "repoScore": 68.5, + "findingCount": 24, + "repoScore": 62, "physicalLineCount": 138854, "logicalLineCount": 80948, "functionCount": 0, "normalized": { - "scorePerFile": 0.03514622883530016, - "scorePerKloc": 0.846222266146168, - "scorePerFunction": null, - "findingsPerFile": 0.013853258081067214, - "findingsPerKloc": 0.33354746256856255, - "findingsPerFunction": null - } - } - }, - { - "id": "vite", - "repo": "vitejs/vite", - "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", - "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 8, - "repoScore": 19, - "physicalLineCount": 77629, - "logicalLineCount": 37251, - "functionCount": 0, - "normalized": { - "scorePerFile": 0.015459723352318959, - "scorePerKloc": 0.5100534213846608, + "scorePerFile": 0.03181118522319138, + "scorePerKloc": 0.7659238029352178, "scorePerFunction": null, - "findingsPerFile": 0.006509357200976403, - "findingsPerKloc": 0.2147593353198572, + "findingsPerFile": 0.012314007183170857, + "findingsPerKloc": 0.29648663339427783, "findingsPerFunction": null } } @@ -2420,13 +1802,13 @@ "fileCount": 512, "directoryCount": 87, "findingCount": 3, - "repoScore": 9, + "repoScore": 8, "physicalLineCount": 29677, "logicalLineCount": 20508, "functionCount": 0, "normalized": { - "scorePerFile": 0.017578125, - "scorePerKloc": 0.43885313048566416, + "scorePerFile": 0.015625, + "scorePerKloc": 0.3900916715428126, "scorePerFunction": null, "findingsPerFile": 0.005859375, "findingsPerKloc": 0.14628437682855472, @@ -2442,17 +1824,17 @@ "summary": { "fileCount": 4234, "directoryCount": 1837, - "findingCount": 33, - "repoScore": 83, + "findingCount": 13, + "repoScore": 41, "physicalLineCount": 384327, "logicalLineCount": 251992, "functionCount": 0, "normalized": { - "scorePerFile": 0.019603212092583845, - "scorePerKloc": 0.3293755357312931, + "scorePerFile": 0.009683514407179971, + "scorePerKloc": 0.16270357789136164, "scorePerFunction": null, - "findingsPerFile": 0.007794048181388758, - "findingsPerKloc": 0.13095653830280327, + "findingsPerFile": 0.0030703826169107226, + "findingsPerKloc": 0.051588939331407346, "findingsPerFunction": null } } @@ -2465,120 +1847,97 @@ "summary": { "fileCount": 580, "directoryCount": 46, - "findingCount": 1, - "repoScore": 3, + "findingCount": 0, + "repoScore": 0, "physicalLineCount": 35995, "logicalLineCount": 20374, "functionCount": 0, "normalized": { - "scorePerFile": 0.005172413793103448, - "scorePerKloc": 0.1472464906253068, + "scorePerFile": 0, + "scorePerKloc": 0, "scorePerFunction": null, - "findingsPerFile": 0.0017241379310344827, - "findingsPerKloc": 0.049082163541768926, + "findingsPerFile": 0, + "findingsPerKloc": 0, "findingsPerFunction": null } } } ], - "rank": 8 + "rank": 6 }, { - "ruleId": "structure.duplicate-function-signatures", - "ruleSlug": "duplicate-function-signatures", - "family": "structure", - "severity": "medium", + "ruleId": "types.generic-record-casts", + "ruleSlug": "generic-record-casts", + "family": "types", + "severity": "strong", "scope": "file", "requires": [ - "repo.duplicateFunctionSignatures" + "file.ast" ], - "signalScore": 0.32222222222222224, + "signalScore": 0.6666666666666666, "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.4, + "bestMetricAuc": 0.75, "metricAucs": { - "scorePerFile": 0.4, - "scorePerKloc": 0.3, - "scorePerFunction": 0.26666666666666666, - "findingsPerFile": 0.4, - "findingsPerKloc": 0.26666666666666666, - "findingsPerFunction": 0.3 + "scorePerFile": 0.75, + "scorePerKloc": 0.75, + "scorePerFunction": 0.5, + "findingsPerFile": 0.75, + "findingsPerKloc": 0.75, + "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, - "hitCount": 2, - "hitRate": 0.3333333333333333, + "hitCount": 3, + "hitRate": 0.5, + "repoScoreMedian": 1, + "findingCountMedian": 0.5, + "medians": { + "scorePerFile": 0.001771479185119575, + "scorePerKloc": 0.03360045696621474, + "scorePerFunction": null, + "findingsPerFile": 0.0004428697962798937, + "findingsPerKloc": 0.008400114241553685, + "findingsPerFunction": null + } + }, + "mature-oss": { + "repoCount": 5, + "hitCount": 0, + "hitRate": 0, "repoScoreMedian": 0, "findingCountMedian": 0, "medians": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 - } - }, - "mature-oss": { - "repoCount": 5, - "hitCount": 4, - "hitRate": 0.8, - "repoScoreMedian": 25.75, - "findingCountMedian": 12, - "medians": { - "scorePerFile": 0.038994356080041044, - "scorePerKloc": 0.9388743390818798, - "scorePerFunction": 0.025182239893969515, - "findingsPerFile": 0.014366341713699333, - "findingsPerKloc": 0.3459010722933241, - "findingsPerFunction": 0.00927766732935719 + "findingsPerFunction": null } } }, "repos": [ { - "id": "vinext", - "repo": "cloudflare/vinext", - "cohort": "explicit-ai", - "ref": "28980b01f1692b47756a6768fc5733712c290f84", - "summary": { - "fileCount": 1129, - "directoryCount": 486, - "findingCount": 50, - "repoScore": 143.25, - "physicalLineCount": 150365, - "logicalLineCount": 59523, - "functionCount": 2917, - "normalized": { - "scorePerFile": 0.12688219663418954, - "scorePerKloc": 2.4066327302051307, - "scorePerFunction": 0.04910867329448063, - "findingsPerFile": 0.04428697962798937, - "findingsPerKloc": 0.8400114241553684, - "findingsPerFunction": 0.017140898183064794 - } - } - }, - { - "id": "openusage", - "repo": "robinebers/openusage", + "id": "hunk", + "repo": "modem-dev/hunk", "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "ref": "b37663f3c3055f860290587865199192e15d9f35", "summary": { - "fileCount": 139, - "directoryCount": 29, - "findingCount": 5, - "repoScore": 11.25, - "physicalLineCount": 33794, - "logicalLineCount": 22270, - "functionCount": 491, + "fileCount": 166, + "directoryCount": 36, + "findingCount": 2, + "repoScore": 6, + "physicalLineCount": 32498, + "logicalLineCount": 13564, + "functionCount": 0, "normalized": { - "scorePerFile": 0.08093525179856115, - "scorePerKloc": 0.5051638976201167, - "scorePerFunction": 0.022912423625254582, - "findingsPerFile": 0.03597122302158273, - "findingsPerKloc": 0.224517287831163, - "findingsPerFunction": 0.010183299389002037 + "scorePerFile": 0.03614457831325301, + "scorePerKloc": 0.4423473901503981, + "scorePerFunction": null, + "findingsPerFile": 0.012048192771084338, + "findingsPerKloc": 0.14744913005013272, + "findingsPerFunction": null } } }, @@ -2590,64 +1949,64 @@ "summary": { "fileCount": 176, "directoryCount": 19, - "findingCount": 0, - "repoScore": 0, + "findingCount": 1, + "repoScore": 2, "physicalLineCount": 62616, "logicalLineCount": 18958, - "functionCount": 832, + "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": 0 + "scorePerFile": 0.011363636363636364, + "scorePerKloc": 0.10549636037556705, + "scorePerFunction": null, + "findingsPerFile": 0.005681818181818182, + "findingsPerKloc": 0.052748180187783524, + "findingsPerFunction": null } } }, { - "id": "devworkbench", - "repo": "jiayun/DevWorkbench", + "id": "vinext", + "repo": "cloudflare/vinext", "cohort": "explicit-ai", - "ref": "ea50862107c377b0cdd6e508073ad0330b367576", + "ref": "28980b01f1692b47756a6768fc5733712c290f84", "summary": { - "fileCount": 32, - "directoryCount": 7, - "findingCount": 0, - "repoScore": 0, - "physicalLineCount": 9408, - "logicalLineCount": 2986, - "functionCount": 147, + "fileCount": 1129, + "directoryCount": 486, + "findingCount": 1, + "repoScore": 4, + "physicalLineCount": 150365, + "logicalLineCount": 59523, + "functionCount": 0, "normalized": { - "scorePerFile": 0, - "scorePerKloc": 0, - "scorePerFunction": 0, - "findingsPerFile": 0, - "findingsPerKloc": 0, - "findingsPerFunction": 0 + "scorePerFile": 0.00354295837023915, + "scorePerKloc": 0.06720091393242948, + "scorePerFunction": null, + "findingsPerFile": 0.0008857395925597874, + "findingsPerKloc": 0.01680022848310737, + "findingsPerFunction": null } } }, { - "id": "hunk", - "repo": "modem-dev/hunk", + "id": "devworkbench", + "repo": "jiayun/DevWorkbench", "cohort": "explicit-ai", - "ref": "b37663f3c3055f860290587865199192e15d9f35", + "ref": "ea50862107c377b0cdd6e508073ad0330b367576", "summary": { - "fileCount": 166, - "directoryCount": 36, + "fileCount": 32, + "directoryCount": 7, "findingCount": 0, "repoScore": 0, - "physicalLineCount": 32498, - "logicalLineCount": 13564, - "functionCount": 752, + "physicalLineCount": 9408, + "logicalLineCount": 2986, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } }, @@ -2663,37 +2022,37 @@ "repoScore": 0, "physicalLineCount": 17222, "logicalLineCount": 8474, - "functionCount": 220, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } }, { - "id": "umami", - "repo": "umami-software/umami", - "cohort": "mature-oss", - "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", + "id": "openusage", + "repo": "robinebers/openusage", + "cohort": "explicit-ai", + "ref": "857f537a243483acf98ccd9ea32e20b380c63823", "summary": { - "fileCount": 512, - "directoryCount": 87, - "findingCount": 12, - "repoScore": 25.75, - "physicalLineCount": 29677, - "logicalLineCount": 20508, - "functionCount": 911, + "fileCount": 139, + "directoryCount": 29, + "findingCount": 0, + "repoScore": 0, + "physicalLineCount": 33794, + "logicalLineCount": 22270, + "functionCount": 0, "normalized": { - "scorePerFile": 0.05029296875, - "scorePerKloc": 1.255607567778428, - "scorePerFunction": 0.028265642151481887, - "findingsPerFile": 0.0234375, - "findingsPerKloc": 0.5851375073142189, - "findingsPerFunction": 0.013172338090010977 + "scorePerFile": 0, + "scorePerKloc": 0, + "scorePerFunction": null, + "findingsPerFile": 0, + "findingsPerKloc": 0, + "findingsPerFunction": null } } }, @@ -2705,41 +2064,18 @@ "summary": { "fileCount": 4234, "directoryCount": 1837, - "findingCount": 131, - "repoScore": 309, + "findingCount": 0, + "repoScore": 0, "physicalLineCount": 384327, "logicalLineCount": 251992, - "functionCount": 3544, - "normalized": { - "scorePerFile": 0.07298063297118564, - "scorePerKloc": 1.226229404108067, - "scorePerFunction": 0.08718961625282166, - "findingsPerFile": 0.030940009447331128, - "findingsPerKloc": 0.5198577732626433, - "findingsPerFunction": 0.036963882618510156 - } - } - }, - { - "id": "astro", - "repo": "withastro/astro", - "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", - "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 28, - "repoScore": 76, - "physicalLineCount": 138854, - "logicalLineCount": 80948, - "functionCount": 3018, + "functionCount": 0, "normalized": { - "scorePerFile": 0.038994356080041044, - "scorePerKloc": 0.9388743390818798, - "scorePerFunction": 0.025182239893969515, - "findingsPerFile": 0.014366341713699333, - "findingsPerKloc": 0.3459010722933241, - "findingsPerFunction": 0.00927766732935719 + "scorePerFile": 0, + "scorePerKloc": 0, + "scorePerFunction": null, + "findingsPerFile": 0, + "findingsPerKloc": 0, + "findingsPerFunction": null } } }, @@ -2751,18 +2087,41 @@ "summary": { "fileCount": 580, "directoryCount": 46, - "findingCount": 6, - "repoScore": 7.5, + "findingCount": 0, + "repoScore": 0, "physicalLineCount": 35995, "logicalLineCount": 20374, - "functionCount": 1007, + "functionCount": 0, + "normalized": { + "scorePerFile": 0, + "scorePerKloc": 0, + "scorePerFunction": null, + "findingsPerFile": 0, + "findingsPerKloc": 0, + "findingsPerFunction": null + } + } + }, + { + "id": "umami", + "repo": "umami-software/umami", + "cohort": "mature-oss", + "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", + "summary": { + "fileCount": 512, + "directoryCount": 87, + "findingCount": 0, + "repoScore": 0, + "physicalLineCount": 29677, + "logicalLineCount": 20508, + "functionCount": 0, "normalized": { - "scorePerFile": 0.01293103448275862, - "scorePerKloc": 0.3681162265632669, - "scorePerFunction": 0.007447864945382324, - "findingsPerFile": 0.010344827586206896, - "findingsPerKloc": 0.2944929812506136, - "findingsPerFunction": 0.005958291956305859 + "scorePerFile": 0, + "scorePerKloc": 0, + "scorePerFunction": null, + "findingsPerFile": 0, + "findingsPerKloc": 0, + "findingsPerFunction": null } } }, @@ -2778,93 +2137,116 @@ "repoScore": 0, "physicalLineCount": 77629, "logicalLineCount": 37251, - "functionCount": 1904, + "functionCount": 0, + "normalized": { + "scorePerFile": 0, + "scorePerKloc": 0, + "scorePerFunction": null, + "findingsPerFile": 0, + "findingsPerKloc": 0, + "findingsPerFunction": null + } + } + }, + { + "id": "astro", + "repo": "withastro/astro", + "cohort": "mature-oss", + "ref": "f7068995aa451dced13853789b0d51433c2373b5", + "summary": { + "fileCount": 1949, + "directoryCount": 852, + "findingCount": 0, + "repoScore": 0, + "physicalLineCount": 138854, + "logicalLineCount": 80948, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } } ], - "rank": 9 + "rank": 7 }, { - "ruleId": "structure.directory-fanout-hotspot", - "ruleSlug": "directory-fanout-hotspot", - "family": "structure", - "severity": "medium", - "scope": "directory", + "ruleId": "defensive.error-obscuring", + "ruleSlug": "error-obscuring", + "family": "defensive", + "severity": "strong", + "scope": "file", "requires": [ - "directory.metrics" + "file.tryCatchSummaries" ], - "signalScore": 0.22222222222222224, + "signalScore": 0.6555555555555556, "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.5, + "bestMetricAuc": 0.8333333333333334, "metricAucs": { - "scorePerFile": 0.4666666666666667, - "scorePerKloc": 0.13333333333333333, - "scorePerFunction": 0.1, - "findingsPerFile": 0.5, - "findingsPerKloc": 0.1, - "findingsPerFunction": 0.03333333333333333 + "scorePerFile": 0.8, + "scorePerKloc": 0.6, + "scorePerFunction": 0.5, + "findingsPerFile": 0.8333333333333334, + "findingsPerKloc": 0.7, + "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, - "hitCount": 6, - "hitRate": 1, - "repoScoreMedian": 6.097222222222223, - "findingCountMedian": 1.5, + "hitCount": 5, + "hitRate": 0.8333333333333334, + "repoScoreMedian": 9.4, + "findingCountMedian": 4.5, "medians": { - "scorePerFile": 0.051404198968162076, - "scorePerKloc": 0.5428176498054266, - "scorePerFunction": 0.014598312555288116, - "findingsPerFile": 0.013837291548514954, - "findingsPerKloc": 0.16959085981043406, - "findingsPerFunction": 0.00430938715052768 + "scorePerFile": 0.06158622769161187, + "scorePerKloc": 0.8214329438453718, + "scorePerFunction": null, + "findingsPerFile": 0.026586321919228086, + "findingsPerKloc": 0.37861477861579207, + "findingsPerFunction": null } }, "mature-oss": { "repoCount": 5, "hitCount": 5, "hitRate": 1, - "repoScoreMedian": 76.98412698412699, - "findingCountMedian": 21, + "repoScoreMedian": 14.4, + "findingCountMedian": 5, "medians": { - "scorePerFile": 0.044517510484307354, - "scorePerKloc": 1.1346421384736092, - "scorePerFunction": 0.028696507821756326, - "findingsPerFile": 0.012314007183170857, - "findingsPerKloc": 0.3055652560398743, - "findingsPerFunction": 0.007952286282306162 + "scorePerFile": 0.018233349078885217, + "scorePerKloc": 0.38656680357574297, + "scorePerFunction": null, + "findingsPerFile": 0.006613131790269249, + "findingsPerKloc": 0.13422458457491074, + "findingsPerFunction": null } } }, "repos": [ { - "id": "devworkbench", - "repo": "jiayun/DevWorkbench", + "id": "gstack", + "repo": "garrytan/gstack", "cohort": "explicit-ai", - "ref": "ea50862107c377b0cdd6e508073ad0330b367576", + "ref": "6cc094cd4190e3fac65b69fb29e0c3cae7e0f214", "summary": { - "fileCount": 32, - "directoryCount": 7, - "findingCount": 1, - "repoScore": 4.833333333333334, - "physicalLineCount": 9408, - "logicalLineCount": 2986, - "functionCount": 147, + "fileCount": 176, + "directoryCount": 19, + "findingCount": 19, + "repoScore": 49.40000000000002, + "physicalLineCount": 62616, + "logicalLineCount": 18958, + "functionCount": 0, "normalized": { - "scorePerFile": 0.15104166666666669, - "scorePerKloc": 1.6186648805536952, - "scorePerFunction": 0.03287981859410431, - "findingsPerFile": 0.03125, - "findingsPerKloc": 0.3348961821835231, - "findingsPerFunction": 0.006802721088435374 + "scorePerFile": 0.2806818181818183, + "scorePerKloc": 2.6057601012765073, + "scorePerFunction": null, + "findingsPerFile": 0.10795454545454546, + "findingsPerKloc": 1.002215423567887, + "findingsPerFunction": null } } }, @@ -2876,18 +2258,18 @@ "summary": { "fileCount": 1129, "directoryCount": 486, - "findingCount": 15, - "repoScore": 56.28151260504201, + "findingCount": 24, + "repoScore": 69.40000000000002, "physicalLineCount": 150365, "logicalLineCount": 59523, - "functionCount": 2917, + "functionCount": 0, "normalized": { - "scorePerFile": 0.04985076404343845, - "scorePerKloc": 0.9455422711395932, - "scorePerFunction": 0.019294313543038056, - "findingsPerFile": 0.013286093888396812, - "findingsPerKloc": 0.25200342724661057, - "findingsPerFunction": 0.005142269454919438 + "scorePerFile": 0.061470327723649264, + "scorePerKloc": 1.1659358567276519, + "scorePerFunction": null, + "findingsPerFile": 0.021257750221434897, + "findingsPerKloc": 0.40320548359457686, + "findingsPerFunction": null } } }, @@ -2899,18 +2281,18 @@ "summary": { "fileCount": 166, "directoryCount": 36, - "findingCount": 3, - "repoScore": 9.723492063492063, + "findingCount": 6, + "repoScore": 13, "physicalLineCount": 32498, "logicalLineCount": 13564, - "functionCount": 752, + "functionCount": 0, "normalized": { - "scorePerFile": 0.0585752533945305, - "scorePerKloc": 0.7168602229056372, - "scorePerFunction": 0.012930175616345829, - "findingsPerFile": 0.018072289156626505, - "findingsPerKloc": 0.22117369507519904, - "findingsPerFunction": 0.003989361702127659 + "scorePerFile": 0.0783132530120482, + "scorePerKloc": 0.9584193453258626, + "scorePerFunction": null, + "findingsPerFile": 0.03614457831325301, + "findingsPerKloc": 0.4423473901503981, + "findingsPerFunction": null } } }, @@ -2922,18 +2304,18 @@ "summary": { "fileCount": 94, "directoryCount": 24, - "findingCount": 1, - "repoScore": 3.125, + "findingCount": 3, + "repoScore": 5.800000000000001, "physicalLineCount": 17222, "logicalLineCount": 8474, - "functionCount": 220, + "functionCount": 0, "normalized": { - "scorePerFile": 0.03324468085106383, - "scorePerKloc": 0.3687750767052159, - "scorePerFunction": 0.014204545454545454, - "findingsPerFile": 0.010638297872340425, - "findingsPerKloc": 0.1180080245456691, - "findingsPerFunction": 0.004545454545454545 + "scorePerFile": 0.061702127659574474, + "scorePerKloc": 0.6844465423648809, + "scorePerFunction": null, + "findingsPerFile": 0.031914893617021274, + "findingsPerKloc": 0.35402407363700733, + "findingsPerFunction": null } } }, @@ -2946,214 +2328,237 @@ "fileCount": 139, "directoryCount": 29, "findingCount": 2, - "repoScore": 7.361111111111112, + "repoScore": 4.2, "physicalLineCount": 33794, "logicalLineCount": 22270, - "functionCount": 491, + "functionCount": 0, "normalized": { - "scorePerFile": 0.05295763389288569, - "scorePerKloc": 0.3305393404181011, - "scorePerFunction": 0.014992079656030777, + "scorePerFile": 0.030215827338129497, + "scorePerKloc": 0.18859452177817693, + "scorePerFunction": null, "findingsPerFile": 0.014388489208633094, "findingsPerKloc": 0.0898069151324652, - "findingsPerFunction": 0.004073319755600814 + "findingsPerFunction": null } } }, { - "id": "gstack", - "repo": "garrytan/gstack", + "id": "devworkbench", + "repo": "jiayun/DevWorkbench", "cohort": "explicit-ai", - "ref": "6cc094cd4190e3fac65b69fb29e0c3cae7e0f214", + "ref": "ea50862107c377b0cdd6e508073ad0330b367576", "summary": { - "fileCount": 176, - "directoryCount": 19, - "findingCount": 1, - "repoScore": 3, - "physicalLineCount": 62616, - "logicalLineCount": 18958, - "functionCount": 832, + "fileCount": 32, + "directoryCount": 7, + "findingCount": 0, + "repoScore": 0, + "physicalLineCount": 9408, + "logicalLineCount": 2986, + "functionCount": 0, "normalized": { - "scorePerFile": 0.017045454545454544, - "scorePerKloc": 0.15824454056335058, - "scorePerFunction": 0.003605769230769231, - "findingsPerFile": 0.005681818181818182, - "findingsPerKloc": 0.052748180187783524, - "findingsPerFunction": 0.001201923076923077 + "scorePerFile": 0, + "scorePerKloc": 0, + "scorePerFunction": null, + "findingsPerFile": 0, + "findingsPerKloc": 0, + "findingsPerFunction": null } } }, { - "id": "vite", - "repo": "vitejs/vite", + "id": "astro", + "repo": "withastro/astro", "cohort": "mature-oss", - "ref": "a4922537a8d705da7769d30626a0d846511fc124", + "ref": "f7068995aa451dced13853789b0d51433c2373b5", "summary": { - "fileCount": 1229, - "directoryCount": 525, - "findingCount": 21, - "repoScore": 76.98412698412699, - "physicalLineCount": 77629, - "logicalLineCount": 37251, - "functionCount": 1904, + "fileCount": 1949, + "directoryCount": 852, + "findingCount": 26, + "repoScore": 80.7, + "physicalLineCount": 138854, + "logicalLineCount": 80948, + "functionCount": 0, "normalized": { - "scorePerFile": 0.0626396476681261, - "scorePerKloc": 2.0666324926613244, - "scorePerFunction": 0.0404328398025877, - "findingsPerFile": 0.01708706265256306, - "findingsPerKloc": 0.5637432552146251, - "findingsPerFunction": 0.011029411764705883 + "scorePerFile": 0.04140584915341201, + "scorePerKloc": 0.9969363047882592, + "scorePerFunction": null, + "findingsPerFile": 0.013340174448435094, + "findingsPerKloc": 0.321193852843801, + "findingsPerFunction": null } } }, { - "id": "execa", - "repo": "sindresorhus/execa", + "id": "umami", + "repo": "umami-software/umami", "cohort": "mature-oss", - "ref": "99d1741d2525eca71b986282148bbf2983356428", + "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", "summary": { - "fileCount": 580, - "directoryCount": 46, - "findingCount": 7, - "repoScore": 25.680555555555554, - "physicalLineCount": 35995, - "logicalLineCount": 20374, - "functionCount": 1007, + "fileCount": 512, + "directoryCount": 87, + "findingCount": 4, + "repoScore": 11.5, + "physicalLineCount": 29677, + "logicalLineCount": 20508, + "functionCount": 0, "normalized": { - "scorePerFile": 0.044276819923371645, - "scorePerKloc": 1.2604572276212602, - "scorePerFunction": 0.025502041266688733, - "findingsPerFile": 0.01206896551724138, - "findingsPerKloc": 0.3435751447923825, - "findingsPerFunction": 0.006951340615690168 + "scorePerFile": 0.0224609375, + "scorePerKloc": 0.5607567778427931, + "scorePerFunction": null, + "findingsPerFile": 0.0078125, + "findingsPerKloc": 0.1950458357714063, + "findingsPerFunction": null } } }, { - "id": "payload", - "repo": "payloadcms/payload", + "id": "vite", + "repo": "vitejs/vite", "cohort": "mature-oss", - "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", + "ref": "a4922537a8d705da7769d30626a0d846511fc124", "summary": { - "fileCount": 4234, - "directoryCount": 1837, - "findingCount": 77, - "repoScore": 285.9207417582417, - "physicalLineCount": 384327, - "logicalLineCount": 251992, - "functionCount": 3544, + "fileCount": 1229, + "directoryCount": 525, + "findingCount": 5, + "repoScore": 14.4, + "physicalLineCount": 77629, + "logicalLineCount": 37251, + "functionCount": 0, "normalized": { - "scorePerFile": 0.06752969810067116, - "scorePerKloc": 1.1346421384736092, - "scorePerFunction": 0.08067741020266414, - "findingsPerFile": 0.018186112423240433, - "findingsPerKloc": 0.3055652560398743, - "findingsPerFunction": 0.02172686230248307 + "scorePerFile": 0.011716842961757526, + "scorePerKloc": 0.38656680357574297, + "scorePerFunction": null, + "findingsPerFile": 0.0040683482506102524, + "findingsPerKloc": 0.13422458457491074, + "findingsPerFunction": null } } }, { - "id": "umami", - "repo": "umami-software/umami", + "id": "payload", + "repo": "payloadcms/payload", "cohort": "mature-oss", - "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", + "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", "summary": { - "fileCount": 512, - "directoryCount": 87, - "findingCount": 6, - "repoScore": 22.792965367965365, - "physicalLineCount": 29677, - "logicalLineCount": 20508, - "functionCount": 911, + "fileCount": 4234, + "directoryCount": 1837, + "findingCount": 28, + "repoScore": 77.2, + "physicalLineCount": 384327, + "logicalLineCount": 251992, + "functionCount": 0, "normalized": { - "scorePerFile": 0.044517510484307354, - "scorePerKloc": 1.111418244975881, - "scorePerFunction": 0.02501972049172927, - "findingsPerFile": 0.01171875, - "findingsPerKloc": 0.29256875365710944, - "findingsPerFunction": 0.006586169045005488 + "scorePerFile": 0.018233349078885217, + "scorePerKloc": 0.30635893202958825, + "scorePerFunction": null, + "findingsPerFile": 0.006613131790269249, + "findingsPerKloc": 0.11111463855995429, + "findingsPerFunction": null } } }, { - "id": "astro", - "repo": "withastro/astro", + "id": "execa", + "repo": "sindresorhus/execa", "cohort": "mature-oss", - "ref": "f7068995aa451dced13853789b0d51433c2373b5", + "ref": "99d1741d2525eca71b986282148bbf2983356428", "summary": { - "fileCount": 1949, - "directoryCount": 852, - "findingCount": 24, - "repoScore": 86.6060606060606, - "physicalLineCount": 138854, - "logicalLineCount": 80948, - "functionCount": 3018, + "fileCount": 580, + "directoryCount": 46, + "findingCount": 1, + "repoScore": 5, + "physicalLineCount": 35995, + "logicalLineCount": 20374, + "functionCount": 0, "normalized": { - "scorePerFile": 0.04443615218371503, - "scorePerKloc": 1.0698974725263206, - "scorePerFunction": 0.028696507821756326, - "findingsPerFile": 0.012314007183170857, - "findingsPerKloc": 0.29648663339427783, - "findingsPerFunction": 0.007952286282306162 + "scorePerFile": 0.008620689655172414, + "scorePerKloc": 0.24541081770884463, + "scorePerFunction": null, + "findingsPerFile": 0.0017241379310344827, + "findingsPerKloc": 0.049082163541768926, + "findingsPerFunction": null } } } ], - "rank": 10 + "rank": 8 }, { - "ruleId": "structure.over-fragmentation", - "ruleSlug": "over-fragmentation", - "family": "structure", - "severity": "strong", - "scope": "directory", + "ruleId": "tests.duplicate-mock-setup", + "ruleSlug": "duplicate-mock-setup", + "family": "tests", + "severity": "medium", + "scope": "file", "requires": [ - "directory.metrics" + "repo.testMockDuplication" ], - "signalScore": 0.1722222222222222, + "signalScore": 0.6333333333333333, "bestMetric": "findingsPerFile", - "bestMetricAuc": 0.18333333333333332, + "bestMetricAuc": 0.7, "metricAucs": { - "scorePerFile": 0.18333333333333332, - "scorePerKloc": 0.18333333333333332, - "scorePerFunction": 0.15, - "findingsPerFile": 0.18333333333333332, - "findingsPerKloc": 0.18333333333333332, - "findingsPerFunction": 0.15 + "scorePerFile": 0.7, + "scorePerKloc": 0.7, + "scorePerFunction": 0.5, + "findingsPerFile": 0.7, + "findingsPerKloc": 0.7, + "findingsPerFunction": 0.5 }, "cohorts": { "explicit-ai": { "repoCount": 6, + "hitCount": 3, + "hitRate": 0.5, + "repoScoreMedian": 4.5, + "findingCountMedian": 1.5, + "medians": { + "scorePerFile": 0.03985828166519043, + "scorePerKloc": 0.5310361104555109, + "scorePerFunction": null, + "findingsPerFile": 0.007971656333038087, + "findingsPerKloc": 0.15120205634796632, + "findingsPerFunction": null + } + }, + "mature-oss": { + "repoCount": 5, "hitCount": 1, - "hitRate": 0.16666666666666666, + "hitRate": 0.2, "repoScoreMedian": 0, "findingCountMedian": 0, "medians": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 - } - }, - "mature-oss": { - "repoCount": 5, - "hitCount": 4, - "hitRate": 0.8, - "repoScoreMedian": 13.934306569343066, - "findingCountMedian": 2, - "medians": { - "scorePerFile": 0.008233837733943608, - "scorePerKloc": 0.13834593544841597, - "scorePerFunction": 0.009836926909005993, - "findingsPerFile": 0.0011809163911195087, - "findingsPerKloc": 0.01984189974284898, - "findingsPerFunction": 0.0014108352144469526 + "findingsPerFunction": null } } }, "repos": [ + { + "id": "openusage", + "repo": "robinebers/openusage", + "cohort": "explicit-ai", + "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "summary": { + "fileCount": 139, + "directoryCount": 29, + "findingCount": 25, + "repoScore": 112, + "physicalLineCount": 33794, + "logicalLineCount": 22270, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.8057553956834532, + "scorePerKloc": 5.029187247418052, + "scorePerFunction": null, + "findingsPerFile": 0.17985611510791366, + "findingsPerKloc": 1.1225864391558151, + "findingsPerFunction": null + } + } + }, { "id": "vinext", "repo": "cloudflare/vinext", @@ -3162,18 +2567,41 @@ "summary": { "fileCount": 1129, "directoryCount": 486, - "findingCount": 3, - "repoScore": 20.12121212121212, + "findingCount": 18, + "repoScore": 90, "physicalLineCount": 150365, "logicalLineCount": 59523, - "functionCount": 2917, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.07971656333038087, + "scorePerKloc": 1.5120205634796633, + "scorePerFunction": null, + "findingsPerFile": 0.015943312666076175, + "findingsPerKloc": 0.30240411269593265, + "findingsPerFunction": null + } + } + }, + { + "id": "agent-ci", + "repo": "redwoodjs/agent-ci", + "cohort": "explicit-ai", + "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", + "summary": { + "fileCount": 94, + "directoryCount": 24, + "findingCount": 3, + "repoScore": 9, + "physicalLineCount": 17222, + "logicalLineCount": 8474, + "functionCount": 0, "normalized": { - "scorePerFile": 0.01782215422605148, - "scorePerKloc": 0.3380409609934331, - "scorePerFunction": 0.006897912965790923, - "findingsPerFile": 0.002657218777679362, - "findingsPerKloc": 0.05040068544932211, - "findingsPerFunction": 0.0010284538909838875 + "scorePerFile": 0.09574468085106383, + "scorePerKloc": 1.0620722209110218, + "scorePerFunction": null, + "findingsPerFile": 0.031914893617021274, + "findingsPerKloc": 0.35402407363700733, + "findingsPerFunction": null } } }, @@ -3189,14 +2617,14 @@ "repoScore": 0, "physicalLineCount": 62616, "logicalLineCount": 18958, - "functionCount": 832, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } }, @@ -3212,14 +2640,14 @@ "repoScore": 0, "physicalLineCount": 9408, "logicalLineCount": 2986, - "functionCount": 147, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } }, @@ -3235,60 +2663,83 @@ "repoScore": 0, "physicalLineCount": 32498, "logicalLineCount": 13564, - "functionCount": 752, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } }, { - "id": "agent-ci", - "repo": "redwoodjs/agent-ci", - "cohort": "explicit-ai", - "ref": "4de00d69487e275d5bc37e30f7818a9303b22352", + "id": "payload", + "repo": "payloadcms/payload", + "cohort": "mature-oss", + "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", "summary": { - "fileCount": 94, - "directoryCount": 24, + "fileCount": 4234, + "directoryCount": 1837, + "findingCount": 6, + "repoScore": 22.5, + "physicalLineCount": 384327, + "logicalLineCount": 251992, + "functionCount": 0, + "normalized": { + "scorePerFile": 0.005314123760037789, + "scorePerKloc": 0.0892885488428204, + "scorePerFunction": null, + "findingsPerFile": 0.0014170996693434106, + "findingsPerKloc": 0.023810279691418777, + "findingsPerFunction": null + } + } + }, + { + "id": "execa", + "repo": "sindresorhus/execa", + "cohort": "mature-oss", + "ref": "99d1741d2525eca71b986282148bbf2983356428", + "summary": { + "fileCount": 580, + "directoryCount": 46, "findingCount": 0, "repoScore": 0, - "physicalLineCount": 17222, - "logicalLineCount": 8474, - "functionCount": 220, + "physicalLineCount": 35995, + "logicalLineCount": 20374, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } }, { - "id": "openusage", - "repo": "robinebers/openusage", - "cohort": "explicit-ai", - "ref": "857f537a243483acf98ccd9ea32e20b380c63823", + "id": "umami", + "repo": "umami-software/umami", + "cohort": "mature-oss", + "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", "summary": { - "fileCount": 139, - "directoryCount": 29, + "fileCount": 512, + "directoryCount": 87, "findingCount": 0, "repoScore": 0, - "physicalLineCount": 33794, - "logicalLineCount": 22270, - "functionCount": 491, + "physicalLineCount": 29677, + "logicalLineCount": 20508, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } }, @@ -3300,64 +2751,18 @@ "summary": { "fileCount": 1229, "directoryCount": 525, - "findingCount": 8, - "repoScore": 54.016666666666666, + "findingCount": 0, + "repoScore": 0, "physicalLineCount": 77629, "logicalLineCount": 37251, - "functionCount": 1904, - "normalized": { - "scorePerFile": 0.043951722267426094, - "scorePerKloc": 1.4500729286909524, - "scorePerFunction": 0.028370098039215686, - "findingsPerFile": 0.006509357200976403, - "findingsPerKloc": 0.2147593353198572, - "findingsPerFunction": 0.004201680672268907 - } - } - }, - { - "id": "execa", - "repo": "sindresorhus/execa", - "cohort": "mature-oss", - "ref": "99d1741d2525eca71b986282148bbf2983356428", - "summary": { - "fileCount": 580, - "directoryCount": 46, - "findingCount": 2, - "repoScore": 13.934306569343066, - "physicalLineCount": 35995, - "logicalLineCount": 20374, - "functionCount": 1007, - "normalized": { - "scorePerFile": 0.024024666498867357, - "scorePerKloc": 0.6839259138776415, - "scorePerFunction": 0.013837444458136113, - "findingsPerFile": 0.0034482758620689655, - "findingsPerKloc": 0.09816432708353785, - "findingsPerFunction": 0.0019860973187686196 - } - } - }, - { - "id": "payload", - "repo": "payloadcms/payload", - "cohort": "mature-oss", - "ref": "f3f36d801010f3c95ae74655ff22a09ea66ab1ac", - "summary": { - "fileCount": 4234, - "directoryCount": 1837, - "findingCount": 5, - "repoScore": 34.86206896551724, - "physicalLineCount": 384327, - "logicalLineCount": 251992, - "functionCount": 3544, + "functionCount": 0, "normalized": { - "scorePerFile": 0.008233837733943608, - "scorePerKloc": 0.13834593544841597, - "scorePerFunction": 0.009836926909005993, - "findingsPerFile": 0.0011809163911195087, - "findingsPerKloc": 0.01984189974284898, - "findingsPerFunction": 0.0014108352144469526 + "scorePerFile": 0, + "scorePerKloc": 0, + "scorePerFunction": null, + "findingsPerFile": 0, + "findingsPerKloc": 0, + "findingsPerFunction": null } } }, @@ -3369,46 +2774,23 @@ "summary": { "fileCount": 1949, "directoryCount": 852, - "findingCount": 1, - "repoScore": 6.5, - "physicalLineCount": 138854, - "logicalLineCount": 80948, - "functionCount": 3018, - "normalized": { - "scorePerFile": 0.0033350436121087736, - "scorePerKloc": 0.08029846321095024, - "scorePerFunction": 0.0021537442014579193, - "findingsPerFile": 0.000513083632632119, - "findingsPerKloc": 0.012353609724761577, - "findingsPerFunction": 0.0003313452617627568 - } - } - }, - { - "id": "umami", - "repo": "umami-software/umami", - "cohort": "mature-oss", - "ref": "227b2554b4a373e63ceb7f48decdc60c8d3e6eaf", - "summary": { - "fileCount": 512, - "directoryCount": 87, "findingCount": 0, "repoScore": 0, - "physicalLineCount": 29677, - "logicalLineCount": 20508, - "functionCount": 911, + "physicalLineCount": 138854, + "logicalLineCount": 80948, + "functionCount": 0, "normalized": { "scorePerFile": 0, "scorePerKloc": 0, - "scorePerFunction": 0, + "scorePerFunction": null, "findingsPerFile": 0, "findingsPerKloc": 0, - "findingsPerFunction": 0 + "findingsPerFunction": null } } } ], - "rank": 11 + "rank": 9 } ] } diff --git a/reports/known-ai-vs-solid-oss-benchmark.md b/reports/known-ai-vs-solid-oss-benchmark.md index 7c8833a..909ff0a 100644 --- a/reports/known-ai-vs-solid-oss-benchmark.md +++ b/reports/known-ai-vs-solid-oss-benchmark.md @@ -1,6 +1,6 @@ # Pinned benchmark: Known AI repos vs older solid OSS repos -Date: 2026-04-17 +Date: 2026-04-26 Analyzer version: 0.3.0 Config mode: default @@ -28,67 +28,67 @@ Blended score = geometric mean of the six normalized-metric ratios versus the ma | Repo | Ref | Age | Stars | Blended | Files | Logical LOC | Functions | Score/file | Score/KLOC | Score/function | Findings/file | Findings/KLOC | Findings/function | |---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| -| [garrytan/gstack](https://github.com/garrytan/gstack) | `6cc094c` | 0.1y | 65613 | **5.33** | 176 | 18958 | 832 | 2.34 | 21.71 | 0.49 | 0.52 | 4.85 | 0.11 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | `4de00d6` | 0.2y | 120 | **3.57** | 94 | 8474 | 220 | 0.99 | 10.95 | 0.42 | 0.31 | 3.42 | 0.13 | -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | `ea50862` | 0.8y | 17 | **3.39** | 32 | 2986 | 147 | 1.00 | 10.76 | 0.22 | 0.44 | 4.69 | 0.10 | -| [openclaw/openclaw](https://github.com/openclaw/openclaw) | `44cf747` | 0.4y | 350232 | **3.06** | 10465 | 1031409 | 40348 | 1.04 | 10.60 | 0.27 | 0.32 | 3.22 | 0.08 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | `857f537` | 0.2y | 1715 | **3.02** | 139 | 22270 | 491 | 1.27 | 7.92 | 0.36 | 0.33 | 2.07 | 0.09 | -| [emdash-cms/emdash](https://github.com/emdash-cms/emdash) | `dbaf8c6` | 0.0y | 7842 | **2.17** | 1072 | 120432 | 3513 | 0.73 | 6.54 | 0.22 | 0.22 | 1.98 | 0.07 | -| [FullAgent/fulling](https://github.com/FullAgent/fulling) | `d95060f` | 0.5y | 2413 | **2.16** | 219 | 12154 | 574 | 0.53 | 9.51 | 0.20 | 0.16 | 2.96 | 0.06 | -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | `28980b0` | 0.1y | 7709 | **1.99** | 1129 | 59523 | 2917 | 0.48 | 9.20 | 0.19 | 0.15 | 2.76 | 0.06 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | `b37663f` | 0.1y | 352 | **1.18** | 166 | 13564 | 752 | 0.38 | 4.71 | 0.08 | 0.13 | 1.55 | 0.03 | +| [garrytan/gstack](https://github.com/garrytan/gstack) | `6cc094c` | 0.1y | 65613 | **13.40** | 176 | 18958 | 832 | 2.61 | 24.27 | 0.55 | 0.56 | 5.22 | 0.12 | +| [FullAgent/fulling](https://github.com/FullAgent/fulling) | `d95060f` | 0.5y | 2413 | **10.24** | 219 | 12154 | 574 | 1.28 | 22.98 | 0.49 | 0.29 | 5.27 | 0.11 | +| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | `ea50862` | 0.8y | 17 | **8.99** | 32 | 2986 | 147 | 1.26 | 13.50 | 0.27 | 0.47 | 5.02 | 0.10 | +| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | `4de00d6` | 0.2y | 120 | **8.77** | 94 | 8474 | 220 | 1.06 | 11.77 | 0.45 | 0.33 | 3.66 | 0.14 | +| [openclaw/openclaw](https://github.com/openclaw/openclaw) | `44cf747` | 0.4y | 350232 | **6.91** | 10465 | 1031409 | 40348 | 1.07 | 10.90 | 0.28 | 0.30 | 3.04 | 0.08 | +| [robinebers/openusage](https://github.com/robinebers/openusage) | `857f537` | 0.2y | 1715 | **6.40** | 139 | 22270 | 491 | 1.22 | 7.62 | 0.35 | 0.29 | 1.84 | 0.08 | +| [emdash-cms/emdash](https://github.com/emdash-cms/emdash) | `dbaf8c6` | 0.1y | 7842 | **5.35** | 1072 | 120432 | 3513 | 0.85 | 7.60 | 0.26 | 0.22 | 1.97 | 0.07 | +| [cloudflare/vinext](https://github.com/cloudflare/vinext) | `28980b0` | 0.2y | 7709 | **3.76** | 1129 | 59523 | 2917 | 0.40 | 7.56 | 0.15 | 0.12 | 2.28 | 0.05 | +| [modem-dev/hunk](https://github.com/modem-dev/hunk) | `b37663f` | 0.1y | 352 | **3.21** | 166 | 13564 | 752 | 0.45 | 5.56 | 0.10 | 0.15 | 1.84 | 0.03 | ## Mature OSS cohort | Repo | Ref | Age | Stars | Blended | Files | Logical LOC | Functions | Score/file | Score/KLOC | Score/function | Findings/file | Findings/KLOC | Findings/function | |---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| -| [withastro/astro](https://github.com/withastro/astro) | `f706899` | 5.1y | 58212 | **1.58** | 1949 | 80948 | 3018 | 0.28 | 6.75 | 0.18 | 0.10 | 2.31 | 0.06 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | `f3f36d8` | 5.3y | 41856 | **1.47** | 4234 | 251992 | 3544 | 0.24 | 4.04 | 0.29 | 0.08 | 1.38 | 0.10 | -| [vitejs/vite](https://github.com/vitejs/vite) | `a492253` | 6.0y | 79637 | **1.47** | 1229 | 37251 | 1904 | 0.25 | 8.19 | 0.16 | 0.08 | 2.52 | 0.05 | -| [pmndrs/zustand](https://github.com/pmndrs/zustand) | `2e6d881` | 7.0y | 57758 | **1.45** | 48 | 7096 | 161 | 0.47 | 3.20 | 0.14 | 0.19 | 1.27 | 0.06 | -| [umami-software/umami](https://github.com/umami-software/umami) | `227b255` | 5.8y | 36012 | **1.00** | 512 | 20508 | 911 | 0.17 | 4.36 | 0.10 | 0.07 | 1.66 | 0.04 | -| [egoist/tsup](https://github.com/egoist/tsup) | `cd03e1e` | 6.1y | 11198 | **0.95** | 46 | 2668 | 140 | 0.22 | 3.83 | 0.07 | 0.09 | 1.50 | 0.03 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | `99d1741` | 10.4y | 7481 | **0.89** | 580 | 20374 | 1007 | 0.17 | 4.86 | 0.10 | 0.05 | 1.37 | 0.03 | -| [mikaelbr/node-notifier](https://github.com/mikaelbr/node-notifier) | `b36c237` | 13.4y | 5843 | **0.41** | 24 | 2114 | 42 | 0.08 | 0.90 | 0.05 | 0.04 | 0.47 | 0.02 | -| [vercel/hyper](https://github.com/vercel/hyper) | `2a7bb18` | 9.8y | 44687 | **0.41** | 113 | 65075 | 5354 | 0.65 | 1.12 | 0.01 | 0.16 | 0.28 | 0.00 | +| [withastro/astro](https://github.com/withastro/astro) | `f706899` | 5.1y | 58212 | **2.07** | 1949 | 80948 | 3018 | 0.16 | 3.89 | 0.10 | 0.05 | 1.32 | 0.04 | +| [vitejs/vite](https://github.com/vitejs/vite) | `a492253` | 6.0y | 79637 | **1.76** | 1229 | 37251 | 1904 | 0.12 | 4.02 | 0.08 | 0.04 | 1.40 | 0.03 | +| [egoist/tsup](https://github.com/egoist/tsup) | `cd03e1e` | 6.1y | 11198 | **1.57** | 46 | 2668 | 140 | 0.15 | 2.62 | 0.05 | 0.07 | 1.12 | 0.02 | +| [pmndrs/zustand](https://github.com/pmndrs/zustand) | `2e6d881` | 7.0y | 57758 | **1.45** | 48 | 7096 | 161 | 0.20 | 1.37 | 0.06 | 0.08 | 0.56 | 0.02 | +| [payloadcms/payload](https://github.com/payloadcms/payload) | `f3f36d8` | 5.3y | 41856 | **1.00** | 4234 | 251992 | 3544 | 0.07 | 1.23 | 0.09 | 0.02 | 0.40 | 0.03 | +| [sindresorhus/execa](https://github.com/sindresorhus/execa) | `99d1741` | 10.4y | 7481 | **0.99** | 580 | 20374 | 1007 | 0.09 | 2.50 | 0.05 | 0.02 | 0.64 | 0.01 | +| [mikaelbr/node-notifier](https://github.com/mikaelbr/node-notifier) | `b36c237` | 13.4y | 5843 | **0.95** | 24 | 2114 | 42 | 0.08 | 0.90 | 0.05 | 0.04 | 0.47 | 0.02 | +| [vercel/hyper](https://github.com/vercel/hyper) | `2a7bb18` | 9.8y | 44687 | **0.90** | 113 | 65075 | 5354 | 0.63 | 1.10 | 0.01 | 0.15 | 0.26 | 0.00 | +| [umami-software/umami](https://github.com/umami-software/umami) | `227b255` | 5.8y | 36012 | **0.76** | 512 | 20508 | 911 | 0.06 | 1.48 | 0.03 | 0.02 | 0.54 | 0.01 | ## Cohort medians | Metric | AI median | Solid median | Ratio | |---|---:|---:|---:| -| Blended score | **3.02** | **1.00** | **3.02x** | -| Score / file | **0.99** | **0.24** | **4.11x** | -| Score / KLOC | **9.51** | **4.04** | **2.35x** | -| Score / function | **0.22** | **0.10** | **2.28x** | -| Findings / file | **0.31** | **0.08** | **3.74x** | -| Findings / KLOC | **2.96** | **1.38** | **2.14x** | -| Findings / function | **0.08** | **0.04** | **2.21x** | +| Blended score | **6.91** | **1.00** | **6.91x** | +| Score / file | **1.07** | **0.12** | **8.82x** | +| Score / KLOC | **10.90** | **1.48** | **7.38x** | +| Score / function | **0.28** | **0.05** | **5.51x** | +| Findings / file | **0.29** | **0.04** | **6.97x** | +| Findings / KLOC | **3.04** | **0.56** | **5.39x** | +| Findings / function | **0.08** | **0.02** | **3.51x** | ## Spot-check pairings | AI repo | Solid repo | Score/file ratio | Score/KLOC ratio | Score/function ratio | Findings/file ratio | Findings/KLOC ratio | Findings/function ratio | |---|---|---:|---:|---:|---:|---:|---:| -| `devworkbench` | `hyper` | 1.55x | 9.58x | 16.01x | 2.75x | 16.95x | 28.33x | -| `openusage` | `umami` | 7.27x | 1.82x | 3.66x | 4.98x | 1.25x | 2.51x | -| `vinext` | `vite` | 1.95x | 1.12x | 1.17x | 1.90x | 1.09x | 1.14x | +| `devworkbench` | `hyper` | 1.99x | 12.27x | 20.50x | 3.12x | 19.23x | 32.14x | +| `openusage` | `umami` | 20.63x | 5.16x | 10.39x | 13.73x | 3.43x | 6.92x | +| `vinext` | `vite` | 3.27x | 1.88x | 1.96x | 2.85x | 1.64x | 1.71x | ## Top rule families by cohort ### AI cohort -- `tests.duplicate-mock-setup` — 997 (25.2%) -- `structure.pass-through-wrappers` — 697 (17.6%) -- `defensive.empty-catch` — 463 (11.7%) -- `defensive.error-obscuring` — 456 (11.5%) -- `structure.barrel-density` — 455 (11.5%) -- `structure.duplicate-function-signatures` — 359 (9.1%) +- `tests.duplicate-mock-setup` — 997 (26.3%) +- `structure.pass-through-wrappers` — 697 (18.4%) +- `defensive.empty-catch` — 463 (12.2%) +- `defensive.error-obscuring` — 456 (12.1%) +- `api.generic-status-envelopes` — 424 (11.2%) +- `defensive.promise-default-fallbacks` — 420 (11.1%) ### Mature OSS cohort -- `structure.duplicate-function-signatures` — 177 (24.4%) -- `structure.directory-fanout-hotspot` — 138 (19.1%) -- `defensive.empty-catch` — 93 (12.8%) -- `structure.barrel-density` — 75 (10.4%) -- `structure.pass-through-wrappers` — 73 (10.1%) -- `defensive.error-obscuring` — 67 (9.3%) +- `defensive.empty-catch` — 93 (30.1%) +- `structure.pass-through-wrappers` — 73 (23.6%) +- `defensive.error-obscuring` — 67 (21.7%) +- `defensive.error-swallowing` — 51 (16.5%) +- `defensive.promise-default-fallbacks` — 16 (5.2%) +- `tests.duplicate-mock-setup` — 6 (1.9%) ## Notes diff --git a/reports/known-ai-vs-solid-oss-history.md b/reports/known-ai-vs-solid-oss-history.md index 027668a..908d1e5 100644 --- a/reports/known-ai-vs-solid-oss-history.md +++ b/reports/known-ai-vs-solid-oss-history.md @@ -1,8 +1,8 @@ # Rolling benchmark history: Known AI repos vs older solid OSS repos -Latest update: 2026-04-20 +Latest update: 2026-04-26 History dir: `benchmarks/history/known-ai-vs-solid-oss/` -Pinned baseline snapshot: `benchmarks/results/known-ai-vs-solid-oss.json` (2026-04-17) +Pinned baseline snapshot: `benchmarks/results/known-ai-vs-solid-oss.json` (2026-04-26) Pinned baseline analyzer version: 0.3.0 ## Goal @@ -23,42 +23,42 @@ bun run benchmark:history --recorded-at 2026-04-06T12:00:00Z ## Latest analyzer revisions -- `0.3.0` @ `df9e2d4` — 18 latest repo snapshots +- `0.3.0` @ `326869c` — 18 latest repo snapshots ## Latest cohort medians | Cohort | Repo count | Median current blended | Median score/file | Median findings/file | |---|---:|---:|---:|---:| -| explicit-ai | 9 | **3.51** | 1.39 | 0.36 | -| mature-oss | 9 | **1.00** | 0.27 | 0.09 | +| explicit-ai | 9 | **5.27** | 1.26 | 0.29 | +| mature-oss | 9 | **1.00** | 0.15 | 0.05 | ## AI cohort latest standings | Repo | Points | Trend (pinned) | Latest ref | Current blended | Latest pinned | Highest pinned | Δ prev (pinned) | Δ first (pinned) | Score/file | Findings/file | |---|---:|---|---|---:|---:|---:|---:|---:|---:|---:| -| [FullAgent/fulling](https://github.com/FullAgent/fulling) | 5 | ▁▁▁▁█ | `main@d95060f` | **4.75** | **5.01** | **5.01** | +2.86 | +2.85 | 1.39 | 0.34 | -| [garrytan/gstack](https://github.com/garrytan/gstack) | 5 | █▃▄▁▂ | `main@d0782c4` | **4.65** | **4.90** | **6.37** | +0.13 | -1.47 | 1.86 | 0.45 | -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | 5 | ▁▁▁▁█ | `main@ea50862` | **4.33** | **4.57** | **4.57** | +1.18 | +1.16 | 1.50 | 0.53 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | 5 | ▄▁▁▄█ | `main@37f98a6` | **4.32** | **4.56** | **4.56** | +0.64 | +0.65 | 1.48 | 0.42 | -| [openclaw/openclaw](https://github.com/openclaw/openclaw) | 5 | ▁▁▃▁█ | `main@d2b67fb` | **3.51** | **3.70** | **3.70** | +0.78 | +0.77 | 1.29 | 0.38 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | 5 | ▃▁▁▁█ | `main@584d44d` | **2.99** | **3.16** | **3.16** | +0.13 | +0.09 | 1.45 | 0.36 | -| [emdash-cms/emdash](https://github.com/emdash-cms/emdash) | 3 | ▂▁█ | `main@f7f4814` | **2.91** | **3.07** | **3.07** | +1.06 | +0.90 | 1.14 | 0.31 | -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | 5 | ▂▂▂▁█ | `main@bc03bf1` | **2.33** | **2.46** | **2.46** | +0.53 | +0.47 | 0.60 | 0.19 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | 5 | ▁▃▃▅█ | `main@a6aa1cb` | **1.86** | **1.96** | **1.96** | +0.45 | +1.16 | 0.60 | 0.22 | +| [garrytan/gstack](https://github.com/garrytan/gstack) | 5 | ▃▂▂▁█ | `main@ed1e4be` | **9.15** | **11.14** | **11.14** | +6.37 | +4.77 | 1.78 | 0.45 | +| [FullAgent/fulling](https://github.com/FullAgent/fulling) | 5 | ▁▁▁▁█ | `main@d95060f` | **8.42** | **10.24** | **10.24** | +8.08 | +8.08 | 1.28 | 0.29 | +| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | 5 | ▂▁▁▂█ | `main@76b46f9` | **7.83** | **9.53** | **9.53** | +5.61 | +5.62 | 1.33 | 0.38 | +| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | 5 | ▁▁▁▁█ | `main@ea50862` | **7.39** | **8.99** | **8.99** | +5.60 | +5.59 | 1.26 | 0.47 | +| [robinebers/openusage](https://github.com/robinebers/openusage) | 5 | ▁▁▁▁█ | `main@584d44d` | **5.27** | **6.41** | **6.41** | +3.39 | +3.35 | 1.32 | 0.31 | +| [openclaw/openclaw](https://github.com/openclaw/openclaw) | 5 | ▁▁▁▁█ | `main@6b6dcaf` | **5.26** | **6.40** | **6.40** | +3.48 | +3.47 | 1.00 | 0.28 | +| [emdash-cms/emdash](https://github.com/emdash-cms/emdash) | 3 | ▁▁█ | `main@3dd1a1f` | **4.15** | **5.06** | **5.06** | +3.04 | +2.88 | 0.84 | 0.22 | +| [cloudflare/vinext](https://github.com/cloudflare/vinext) | 5 | ▁▁▁▁█ | `main@67a929b` | **3.06** | **3.73** | **3.73** | +1.80 | +1.74 | 0.40 | 0.12 | +| [modem-dev/hunk](https://github.com/modem-dev/hunk) | 5 | ▁▂▂▃█ | `main@a6aa1cb` | **2.95** | **3.59** | **3.59** | +2.08 | +2.79 | 0.48 | 0.17 | ## Mature OSS cohort latest standings | Repo | Points | Trend (pinned) | Latest ref | Current blended | Latest pinned | Highest pinned | Δ prev (pinned) | Δ first (pinned) | Score/file | Findings/file | |---|---:|---|---|---:|---:|---:|---:|---:|---:|---:| -| [vitejs/vite](https://github.com/vitejs/vite) | 5 | ▃▂▁▂█ | `main@3770a53` | **1.52** | **1.60** | **1.60** | +0.09 | +0.08 | 0.28 | 0.09 | -| [withastro/astro](https://github.com/withastro/astro) | 5 | █▂▁▁█ | `main@05e70f7` | **1.47** | **1.55** | **1.55** | +0.09 | +0.00 | 0.28 | 0.10 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | 5 | ▁▁▁▂█ | `main@48db8c1` | **1.40** | **1.47** | **1.47** | +0.13 | +0.15 | 0.27 | 0.09 | -| [pmndrs/zustand](https://github.com/pmndrs/zustand) | 5 | ██▁▁▁ | `main@3201328` | **1.31** | **1.38** | **1.38** | 0.00 | -0.01 | 0.47 | 0.18 | -| [umami-software/umami](https://github.com/umami-software/umami) | 5 | ▃▁▁▁█ | `master@c78ff36` | **1.00** | **1.05** | **1.05** | +0.01 | +0.01 | 0.18 | 0.07 | -| [egoist/tsup](https://github.com/egoist/tsup) | 5 | ▅▅▅▅▅ | `main@b906f86` | **0.87** | **0.92** | **0.92** | 0.00 | 0.00 | 0.21 | 0.08 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | 5 | ▁▁▁▁█ | `main@f3a2e84` | **0.86** | **0.91** | **0.91** | +0.02 | +0.02 | 0.17 | 0.05 | -| [mikaelbr/node-notifier](https://github.com/mikaelbr/node-notifier) | 5 | ▅▅▅▅▅ | `master@b36c237` | **0.39** | **0.41** | **0.41** | 0.00 | 0.00 | 0.08 | 0.04 | -| [vercel/hyper](https://github.com/vercel/hyper) | 5 | ▅▅▅▅▅ | `canary@2a7bb18` | **0.39** | **0.41** | **0.41** | 0.00 | 0.00 | 0.65 | 0.16 | +| [vitejs/vite](https://github.com/vitejs/vite) | 5 | ▁▁▁▁█ | `main@640202a` | **1.71** | **2.08** | **2.08** | +0.56 | +0.56 | 0.15 | 0.05 | +| [withastro/astro](https://github.com/withastro/astro) | 5 | ▂▁▁▁█ | `main@1058428` | **1.69** | **2.05** | **2.05** | +0.59 | +0.51 | 0.17 | 0.06 | +| [egoist/tsup](https://github.com/egoist/tsup) | 5 | ▁▁▁▁█ | `main@b906f86` | **1.25** | **1.52** | **1.52** | +0.60 | +0.60 | 0.15 | 0.06 | +| [pmndrs/zustand](https://github.com/pmndrs/zustand) | 5 | ██▆▆▁ | `main@95d3f33` | **1.12** | **1.36** | **1.38** | -0.02 | -0.03 | 0.19 | 0.08 | +| [payloadcms/payload](https://github.com/payloadcms/payload) | 5 | ▇▇▇█▁ | `main@0ceba02` | **1.00** | **1.22** | **1.34** | -0.13 | -0.10 | 0.10 | 0.03 | +| [sindresorhus/execa](https://github.com/sindresorhus/execa) | 5 | ▁▁▁▁█ | `main@f3a2e84` | **0.82** | **0.99** | **0.99** | +0.11 | +0.11 | 0.09 | 0.02 | +| [mikaelbr/node-notifier](https://github.com/mikaelbr/node-notifier) | 5 | ▁▁▁▁█ | `master@b36c237` | **0.78** | **0.95** | **0.95** | +0.53 | +0.53 | 0.08 | 0.04 | +| [vercel/hyper](https://github.com/vercel/hyper) | 5 | ▁▁▁▁█ | `canary@2a7bb18` | **0.74** | **0.90** | **0.90** | +0.49 | +0.49 | 0.63 | 0.15 | +| [umami-software/umami](https://github.com/umami-software/umami) | 5 | ████▁ | `master@c78ff36` | **0.70** | **0.85** | **1.04** | -0.19 | -0.19 | 0.07 | 0.02 | ## Table legend @@ -70,15 +70,17 @@ bun run benchmark:history --recorded-at 2026-04-06T12:00:00Z ## Biggest increases vs previous week -- [FullAgent/fulling](https://github.com/FullAgent/fulling) — +2.86 vs previous week (pinned blended) -- [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) — +1.18 vs previous week (pinned blended) -- [emdash-cms/emdash](https://github.com/emdash-cms/emdash) — +1.06 vs previous week (pinned blended) -- [openclaw/openclaw](https://github.com/openclaw/openclaw) — +0.78 vs previous week (pinned blended) -- [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) — +0.64 vs previous week (pinned blended) +- [FullAgent/fulling](https://github.com/FullAgent/fulling) — +8.08 vs previous week (pinned blended) +- [garrytan/gstack](https://github.com/garrytan/gstack) — +6.37 vs previous week (pinned blended) +- [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) — +5.61 vs previous week (pinned blended) +- [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) — +5.60 vs previous week (pinned blended) +- [openclaw/openclaw](https://github.com/openclaw/openclaw) — +3.48 vs previous week (pinned blended) ## Biggest decreases vs previous week -- n/a yet (need at least two weekly points with movement) +- [umami-software/umami](https://github.com/umami-software/umami) — -0.19 vs previous week (pinned blended) +- [payloadcms/payload](https://github.com/payloadcms/payload) — -0.13 vs previous week (pinned blended) +- [pmndrs/zustand](https://github.com/pmndrs/zustand) — -0.02 vs previous week (pinned blended) ## Notes diff --git a/reports/rule-signal-mini.md b/reports/rule-signal-mini.md index 99a0a03..2ec95ad 100644 --- a/reports/rule-signal-mini.md +++ b/reports/rule-signal-mini.md @@ -1,6 +1,6 @@ # Per-rule signal benchmark: Per-rule signal mini benchmark -Date: 2026-04-19 +Date: 2026-04-26 Analyzer version: 0.3.0 Manifest: `benchmarks/sets/rule-signal-mini.json` Summary: `benchmarks/results/rule-signal-mini.json` @@ -16,22 +16,98 @@ Signal score = average AUROC across the six normalized metrics when each rule ru | Rank | Rule | Signal score | AI hit rate | OSS hit rate | Best metric | Best AUROC | |---:|---|---:|---:|---:|---|---:| -| 1 | `defensive.error-swallowing` | **0.72** | 6/6 (100%) | 3/5 (60%) | findings / file | 0.87 | -| 2 | `defensive.empty-catch` | **0.67** | 6/6 (100%) | 5/5 (100%) | findings / file | 0.93 | -| 3 | `structure.pass-through-wrappers` | **0.67** | 5/6 (83%) | 4/5 (80%) | findings / file | 0.85 | -| 4 | `defensive.error-obscuring` | **0.66** | 5/6 (83%) | 5/5 (100%) | findings / file | 0.83 | -| 5 | `tests.duplicate-mock-setup` | **0.63** | 3/6 (50%) | 1/5 (20%) | findings / file | 0.70 | -| 6 | `comments.placeholder-comments` | **0.50** | 0/6 (0%) | 0/5 (0%) | findings / file | 0.50 | -| 7 | `defensive.async-noise` | **0.41** | 3/6 (50%) | 4/5 (80%) | findings / function | 0.50 | -| 8 | `structure.barrel-density` | **0.35** | 3/6 (50%) | 5/5 (100%) | findings / function | 0.50 | -| 9 | `structure.duplicate-function-signatures` | **0.32** | 2/6 (33%) | 4/5 (80%) | findings / file | 0.40 | -| 10 | `structure.directory-fanout-hotspot` | **0.22** | 6/6 (100%) | 5/5 (100%) | findings / file | 0.50 | -| 11 | `structure.over-fragmentation` | **0.17** | 1/6 (17%) | 4/5 (80%) | findings / file | 0.18 | +| 1 | `defensive.promise-default-fallbacks` | **0.81** | 6/6 (100%) | 4/5 (80%) | findings / file | 1.00 | +| 2 | `api.generic-status-envelopes` | **0.76** | 5/6 (83%) | 2/5 (40%) | findings / file | 0.88 | +| 3 | `defensive.error-swallowing` | **0.72** | 6/6 (100%) | 3/5 (60%) | findings / file | 0.87 | +| 4 | `defensive.stringified-unknown-errors` | **0.70** | 4/6 (67%) | 1/5 (20%) | findings / file | 0.80 | +| 5 | `defensive.empty-catch` | **0.67** | 6/6 (100%) | 5/5 (100%) | findings / file | 0.93 | +| 6 | `structure.pass-through-wrappers` | **0.67** | 5/6 (83%) | 4/5 (80%) | findings / file | 0.85 | +| 7 | `types.generic-record-casts` | **0.67** | 3/6 (50%) | 0/5 (0%) | findings / file | 0.75 | +| 8 | `defensive.error-obscuring` | **0.66** | 5/6 (83%) | 5/5 (100%) | findings / file | 0.83 | +| 9 | `tests.duplicate-mock-setup` | **0.63** | 3/6 (50%) | 1/5 (20%) | findings / file | 0.70 | +## defensive.promise-default-fallbacks + +- Rank: **#1** of 9 +- Signal score: **0.81 / 1.00** +- Family / severity / scope: `defensive` / `strong` / `file` +- Best metric: findings / file (1.00) + +### Cohort summary + +| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | +|---|---:|---:|---:|---:|---:|---:| +| explicit-ai | 6/6 (100%) | 3.00 | 10.00 | 0.09 | 1.32 | 0.34 | +| mature-oss | 4/5 (80%) | 3.00 | 6.00 | 0.00 | 0.10 | 0.05 | + +### AUROC by normalized metric + +- score / file: 1.00 +- score / KLOC: 0.97 +- score / function: 0.50 +- findings / file: 1.00 +- findings / KLOC: 0.90 +- findings / function: 0.50 + +### Repo results + +| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | +|---|---|---|---:|---:|---:|---:|---:| +| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 1 | 8.00 | 0.25 | 2.68 | 0.33 | +| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 7 | 40.00 | 0.23 | 2.11 | 0.37 | +| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 30 | 87.00 | 0.08 | 1.46 | 0.50 | +| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 3 | 10.00 | 0.11 | 1.18 | 0.35 | +| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 3 | 10.00 | 0.06 | 0.74 | 0.22 | +| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 1 | 4.00 | 0.03 | 0.18 | 0.04 | +| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 9 | 20.50 | 0.01 | 0.25 | 0.11 | +| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 3 | 6.00 | 0.00 | 0.16 | 0.08 | +| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 1 | 2.00 | 0.00 | 0.10 | 0.05 | +| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 3 | 6.00 | 0.00 | 0.02 | 0.01 | +| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | + +## api.generic-status-envelopes + +- Rank: **#2** of 9 +- Signal score: **0.76 / 1.00** +- Family / severity / scope: `api` / `strong` / `file` +- Best metric: findings / file (0.88) + +### Cohort summary + +| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | +|---|---:|---:|---:|---:|---:|---:| +| explicit-ai | 5/6 (83%) | 1.00 | 5.00 | 0.02 | 0.24 | 0.06 | +| mature-oss | 2/5 (40%) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | + +### AUROC by normalized metric + +- score / file: 0.88 +- score / KLOC: 0.88 +- score / function: 0.50 +- findings / file: 0.88 +- findings / KLOC: 0.88 +- findings / function: 0.50 + +### Repo results + +| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | +|---|---|---|---:|---:|---:|---:|---:| +| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 1 | 8.00 | 0.05 | 0.42 | 0.05 | +| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 1 | 8.00 | 0.06 | 0.36 | 0.04 | +| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 1 | 2.00 | 0.02 | 0.24 | 0.12 | +| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 5 | 14.00 | 0.01 | 0.24 | 0.08 | +| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 1 | 2.00 | 0.01 | 0.15 | 0.07 | +| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 1 | 2.00 | 0.00 | 0.02 | 0.01 | +| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 1 | 6.00 | 0.00 | 0.02 | 0.00 | +| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | + ## defensive.error-swallowing -- Rank: **#1** of 11 +- Rank: **#3** of 9 - Signal score: **0.72 / 1.00** - Family / severity / scope: `defensive` / `strong` / `file` - Best metric: findings / file (0.87) @@ -68,9 +144,48 @@ Signal score = average AUROC across the six normalized metrics when each rule ru | [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | | [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +## defensive.stringified-unknown-errors + +- Rank: **#4** of 9 +- Signal score: **0.70 / 1.00** +- Family / severity / scope: `defensive` / `strong` / `file` +- Best metric: findings / file (0.80) + +### Cohort summary + +| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | +|---|---:|---:|---:|---:|---:|---:| +| explicit-ai | 4/6 (67%) | 1.50 | 5.00 | 0.03 | 0.31 | 0.10 | +| mature-oss | 1/5 (20%) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | + +### AUROC by normalized metric + +- score / file: 0.80 +- score / KLOC: 0.80 +- score / function: 0.50 +- findings / file: 0.80 +- findings / KLOC: 0.80 +- findings / function: 0.50 + +### Repo results + +| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | +|---|---|---|---:|---:|---:|---:|---:| +| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 2 | 8.00 | 0.25 | 2.68 | 0.67 | +| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 11 | 30.00 | 0.03 | 0.50 | 0.18 | +| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 1 | 6.00 | 0.03 | 0.32 | 0.05 | +| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 2 | 4.00 | 0.02 | 0.29 | 0.15 | +| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 1 | 2.00 | 0.00 | 0.02 | 0.01 | +| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | + ## defensive.empty-catch -- Rank: **#2** of 11 +- Rank: **#5** of 9 - Signal score: **0.67 / 1.00** - Family / severity / scope: `defensive` / `strong` / `file` - Best metric: findings / file (0.93) @@ -109,7 +224,7 @@ Signal score = average AUROC across the six normalized metrics when each rule ru ## structure.pass-through-wrappers -- Rank: **#3** of 11 +- Rank: **#6** of 9 - Signal score: **0.67 / 1.00** - Family / severity / scope: `structure` / `strong` / `file` - Best metric: findings / file (0.85) @@ -146,9 +261,48 @@ Signal score = average AUROC across the six normalized metrics when each rule ru | [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 13 | 41.00 | 0.01 | 0.16 | 0.05 | | [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +## types.generic-record-casts + +- Rank: **#7** of 9 +- Signal score: **0.67 / 1.00** +- Family / severity / scope: `types` / `strong` / `file` +- Best metric: findings / file (0.75) + +### Cohort summary + +| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | +|---|---:|---:|---:|---:|---:|---:| +| explicit-ai | 3/6 (50%) | 0.50 | 1.00 | 0.00 | 0.03 | 0.01 | +| mature-oss | 0/5 (0%) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | + +### AUROC by normalized metric + +- score / file: 0.75 +- score / KLOC: 0.75 +- score / function: 0.50 +- findings / file: 0.75 +- findings / KLOC: 0.75 +- findings / function: 0.50 + +### Repo results + +| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | +|---|---|---|---:|---:|---:|---:|---:| +| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 2 | 6.00 | 0.04 | 0.44 | 0.15 | +| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 1 | 2.00 | 0.01 | 0.11 | 0.05 | +| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 1 | 4.00 | 0.00 | 0.07 | 0.02 | +| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | +| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | + ## defensive.error-obscuring -- Rank: **#4** of 11 +- Rank: **#8** of 9 - Signal score: **0.66 / 1.00** - Family / severity / scope: `defensive` / `strong` / `file` - Best metric: findings / file (0.83) @@ -187,7 +341,7 @@ Signal score = average AUROC across the six normalized metrics when each rule ru ## tests.duplicate-mock-setup -- Rank: **#5** of 11 +- Rank: **#9** of 9 - Signal score: **0.63 / 1.00** - Family / severity / scope: `tests` / `medium` / `file` - Best metric: findings / file (0.70) @@ -223,237 +377,3 @@ Signal score = average AUROC across the six normalized metrics when each rule ru | [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | | [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | | [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | - -## comments.placeholder-comments - -- Rank: **#6** of 11 -- Signal score: **0.50 / 1.00** -- Family / severity / scope: `comments` / `weak` / `file` -- Best metric: findings / file (0.50) - -### Cohort summary - -| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | -|---|---:|---:|---:|---:|---:|---:| -| explicit-ai | 0/6 (0%) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -| mature-oss | 0/5 (0%) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | - -### AUROC by normalized metric - -- score / file: 0.50 -- score / KLOC: 0.50 -- score / function: 0.50 -- findings / file: 0.50 -- findings / KLOC: 0.50 -- findings / function: 0.50 - -### Repo results - -| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | -|---|---|---|---:|---:|---:|---:|---:| -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | - -## defensive.async-noise - -- Rank: **#7** of 11 -- Signal score: **0.41 / 1.00** -- Family / severity / scope: `defensive` / `medium` / `file` -- Best metric: findings / function (0.50) - -### Cohort summary - -| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | -|---|---:|---:|---:|---:|---:|---:| -| explicit-ai | 3/6 (50%) | 0.50 | 0.38 | 0.00 | 0.03 | 0.03 | -| mature-oss | 4/5 (80%) | 6.00 | 9.00 | 0.00 | 0.07 | 0.10 | - -### AUROC by normalized metric - -- score / file: 0.42 -- score / KLOC: 0.35 -- score / function: 0.50 -- findings / file: 0.42 -- findings / KLOC: 0.28 -- findings / function: 0.50 - -### Repo results - -| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | -|---|---|---|---:|---:|---:|---:|---:| -| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 2 | 4.50 | 0.03 | 0.24 | 0.11 | -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 4 | 6.00 | 0.01 | 0.10 | 0.07 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 1 | 0.75 | 0.00 | 0.06 | 0.07 | -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 8 | 11.25 | 0.01 | 0.30 | 0.21 | -| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 11 | 18.00 | 0.01 | 0.22 | 0.14 | -| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 2 | 1.50 | 0.00 | 0.07 | 0.10 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 6 | 9.00 | 0.00 | 0.04 | 0.02 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | - -## structure.barrel-density - -- Rank: **#8** of 11 -- Signal score: **0.35 / 1.00** -- Family / severity / scope: `structure` / `medium` / `file` -- Best metric: findings / function (0.50) - -### Cohort summary - -| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | -|---|---:|---:|---:|---:|---:|---:| -| explicit-ai | 3/6 (50%) | 0.50 | 1.00 | 0.00 | 0.06 | 0.03 | -| mature-oss | 5/5 (100%) | 8.00 | 19.00 | 0.02 | 0.44 | 0.15 | - -### AUROC by normalized metric - -- score / file: 0.33 -- score / KLOC: 0.20 -- score / function: 0.50 -- findings / file: 0.33 -- findings / KLOC: 0.23 -- findings / function: 0.50 - -### Repo results - -| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | -|---|---|---|---:|---:|---:|---:|---:| -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 1 | 3.00 | 0.09 | 1.00 | 0.33 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 1 | 2.00 | 0.02 | 0.24 | 0.12 | -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 3 | 7.00 | 0.01 | 0.12 | 0.05 | -| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 27 | 68.50 | 0.04 | 0.85 | 0.33 | -| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 8 | 19.00 | 0.02 | 0.51 | 0.21 | -| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 3 | 9.00 | 0.02 | 0.44 | 0.15 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 33 | 83.00 | 0.02 | 0.33 | 0.13 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 1 | 3.00 | 0.01 | 0.15 | 0.05 | - -## structure.duplicate-function-signatures - -- Rank: **#9** of 11 -- Signal score: **0.32 / 1.00** -- Family / severity / scope: `structure` / `medium` / `file` -- Best metric: findings / file (0.40) - -### Cohort summary - -| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | -|---|---:|---:|---:|---:|---:|---:| -| explicit-ai | 2/6 (33%) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -| mature-oss | 4/5 (80%) | 12.00 | 25.75 | 0.04 | 0.94 | 0.35 | - -### AUROC by normalized metric - -- score / file: 0.40 -- score / KLOC: 0.30 -- score / function: 0.27 -- findings / file: 0.40 -- findings / KLOC: 0.27 -- findings / function: 0.30 - -### Repo results - -| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | -|---|---|---|---:|---:|---:|---:|---:| -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 50 | 143.25 | 0.13 | 2.41 | 0.84 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 5 | 11.25 | 0.08 | 0.51 | 0.22 | -| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 12 | 25.75 | 0.05 | 1.26 | 0.59 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 131 | 309.00 | 0.07 | 1.23 | 0.52 | -| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 28 | 76.00 | 0.04 | 0.94 | 0.35 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 6 | 7.50 | 0.01 | 0.37 | 0.29 | -| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | - -## structure.directory-fanout-hotspot - -- Rank: **#10** of 11 -- Signal score: **0.22 / 1.00** -- Family / severity / scope: `structure` / `medium` / `directory` -- Best metric: findings / file (0.50) - -### Cohort summary - -| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | -|---|---:|---:|---:|---:|---:|---:| -| explicit-ai | 6/6 (100%) | 1.50 | 6.10 | 0.05 | 0.54 | 0.17 | -| mature-oss | 5/5 (100%) | 21.00 | 76.98 | 0.04 | 1.13 | 0.31 | - -### AUROC by normalized metric - -- score / file: 0.47 -- score / KLOC: 0.13 -- score / function: 0.10 -- findings / file: 0.50 -- findings / KLOC: 0.10 -- findings / function: 0.03 - -### Repo results - -| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | -|---|---|---|---:|---:|---:|---:|---:| -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 1 | 4.83 | 0.15 | 1.62 | 0.33 | -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 15 | 56.28 | 0.05 | 0.95 | 0.25 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 3 | 9.72 | 0.06 | 0.72 | 0.22 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 1 | 3.13 | 0.03 | 0.37 | 0.12 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 2 | 7.36 | 0.05 | 0.33 | 0.09 | -| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 1 | 3.00 | 0.02 | 0.16 | 0.05 | -| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 21 | 76.98 | 0.06 | 2.07 | 0.56 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 7 | 25.68 | 0.04 | 1.26 | 0.34 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 77 | 285.92 | 0.07 | 1.13 | 0.31 | -| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 6 | 22.79 | 0.04 | 1.11 | 0.29 | -| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 24 | 86.61 | 0.04 | 1.07 | 0.30 | - -## structure.over-fragmentation - -- Rank: **#11** of 11 -- Signal score: **0.17 / 1.00** -- Family / severity / scope: `structure` / `strong` / `directory` -- Best metric: findings / file (0.18) - -### Cohort summary - -| Cohort | Hit rate | Median findings | Median repo score | Median score / file | Median score / KLOC | Median findings / KLOC | -|---|---:|---:|---:|---:|---:|---:| -| explicit-ai | 1/6 (17%) | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | -| mature-oss | 4/5 (80%) | 2.00 | 13.93 | 0.01 | 0.14 | 0.02 | - -### AUROC by normalized metric - -- score / file: 0.18 -- score / KLOC: 0.18 -- score / function: 0.15 -- findings / file: 0.18 -- findings / KLOC: 0.18 -- findings / function: 0.15 - -### Repo results - -| Repo | Cohort | Ref | Findings | Repo score | Score / file | Score / KLOC | Findings / KLOC | -|---|---|---|---:|---:|---:|---:|---:| -| [cloudflare/vinext](https://github.com/cloudflare/vinext) | explicit-ai | `28980b0` | 3 | 20.12 | 0.02 | 0.34 | 0.05 | -| [garrytan/gstack](https://github.com/garrytan/gstack) | explicit-ai | `6cc094c` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [jiayun/DevWorkbench](https://github.com/jiayun/DevWorkbench) | explicit-ai | `ea50862` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [modem-dev/hunk](https://github.com/modem-dev/hunk) | explicit-ai | `b37663f` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [redwoodjs/agent-ci](https://github.com/redwoodjs/agent-ci) | explicit-ai | `4de00d6` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [robinebers/openusage](https://github.com/robinebers/openusage) | explicit-ai | `857f537` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | -| [vitejs/vite](https://github.com/vitejs/vite) | mature-oss | `a492253` | 8 | 54.02 | 0.04 | 1.45 | 0.21 | -| [sindresorhus/execa](https://github.com/sindresorhus/execa) | mature-oss | `99d1741` | 2 | 13.93 | 0.02 | 0.68 | 0.10 | -| [payloadcms/payload](https://github.com/payloadcms/payload) | mature-oss | `f3f36d8` | 5 | 34.86 | 0.01 | 0.14 | 0.02 | -| [withastro/astro](https://github.com/withastro/astro) | mature-oss | `f706899` | 1 | 6.50 | 0.00 | 0.08 | 0.01 | -| [umami-software/umami](https://github.com/umami-software/umami) | mature-oss | `227b255` | 0 | 0.00 | 0.00 | 0.00 | 0.00 | diff --git a/src/rules/duplicate-mock-setup/README.md b/src/rules/duplicate-mock-setup/README.md index 01d605c..7e0f0a9 100644 --- a/src/rules/duplicate-mock-setup/README.md +++ b/src/rules/duplicate-mock-setup/README.md @@ -65,7 +65,7 @@ Each duplicate setup cluster adds `1 + 0.5 * (fileCount - 2)` for the current fi Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal rank: **#5 of 11** +- Signal rank: **#9 of 9** - Signal score: **0.63 / 1.00** - Best separating metric: **findings / file (0.70)** - Hit rate: **3/6 AI repos** vs **1/5 mature OSS repos** diff --git a/src/rules/empty-catch/README.md b/src/rules/empty-catch/README.md index 1c61cd7..61e0c6c 100644 --- a/src/rules/empty-catch/README.md +++ b/src/rules/empty-catch/README.md @@ -74,7 +74,7 @@ Boundary-oriented catches are downweighted instead of fully ignored. Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal rank: **#2 of 11** +- Signal rank: **#5 of 9** - Signal score: **0.67 / 1.00** - Best separating metric: **findings / file (0.93)** - Hit rate: **6/6 AI repos** vs **5/5 mature OSS repos** diff --git a/src/rules/error-obscuring/README.md b/src/rules/error-obscuring/README.md index 0a1293e..04c5439 100644 --- a/src/rules/error-obscuring/README.md +++ b/src/rules/error-obscuring/README.md @@ -81,7 +81,7 @@ Generic rethrows are still noisy, but scored slightly lower than silent default- Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal rank: **#4 of 11** +- Signal rank: **#8 of 9** - Signal score: **0.66 / 1.00** - Best separating metric: **findings / file (0.83)** - Hit rate: **5/6 AI repos** vs **5/5 mature OSS repos** diff --git a/src/rules/error-swallowing/README.md b/src/rules/error-swallowing/README.md index 33e9c97..2af9efb 100644 --- a/src/rules/error-swallowing/README.md +++ b/src/rules/error-swallowing/README.md @@ -69,7 +69,7 @@ Each flagged catch uses the shared try/catch scoring helper, then the file total Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal rank: **#1 of 11** +- Signal rank: **#3 of 9** - Signal score: **0.72 / 1.00** - Best separating metric: **findings / file (0.87)** - Hit rate: **6/6 AI repos** vs **3/5 mature OSS repos** diff --git a/src/rules/generic-record-casts/README.md b/src/rules/generic-record-casts/README.md index 183c7ff..71fe018 100644 --- a/src/rules/generic-record-casts/README.md +++ b/src/rules/generic-record-casts/README.md @@ -73,9 +73,10 @@ The file total is capped at `8`. ## Benchmark signal -Full pinned benchmark against the exact `known-ai-vs-solid-oss` cohort: +Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal score: **0.78 / 1.00** -- Best separating metric: **findings / file (0.78)** -- Hit rate: **5/9 AI repos** vs **0/9 mature OSS repos** -- Full results: [experimental rule report](../../../reports/autoresearch-candidate-rule.md#typesgeneric-record-casts) +- Signal rank: **#7 of 9** +- Signal score: **0.67 / 1.00** +- Best separating metric: **findings / file (0.75)** +- Hit rate: **3/6 AI repos** vs **0/5 mature OSS repos** +- Full results: [rule signal report](../../../reports/rule-signal-mini.md#typesgeneric-record-casts) diff --git a/src/rules/generic-status-envelopes/README.md b/src/rules/generic-status-envelopes/README.md index 07b6c09..ffd1c8d 100644 --- a/src/rules/generic-status-envelopes/README.md +++ b/src/rules/generic-status-envelopes/README.md @@ -61,9 +61,10 @@ The file total is capped at `8`. ## Benchmark signal -Full pinned benchmark against the exact `known-ai-vs-solid-oss` cohort: +Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal score: **0.93 / 1.00** -- Best separating metric: **findings / file (0.93)** -- Hit rate: **8/9 AI repos** vs **2/9 mature OSS repos** -- Full results: [experimental rule report](../../../reports/autoresearch-candidate-rule.md#apigeneric-status-envelopes) +- Signal rank: **#2 of 9** +- Signal score: **0.76 / 1.00** +- Best separating metric: **findings / file (0.88)** +- Hit rate: **5/6 AI repos** vs **2/5 mature OSS repos** +- Full results: [rule signal report](../../../reports/rule-signal-mini.md#apigeneric-status-envelopes) diff --git a/src/rules/pass-through-wrappers/README.md b/src/rules/pass-through-wrappers/README.md index c058e69..33963cf 100644 --- a/src/rules/pass-through-wrappers/README.md +++ b/src/rules/pass-through-wrappers/README.md @@ -70,7 +70,7 @@ Each wrapper adds `2` points, capped at `5` for the file. Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal rank: **#3 of 11** +- Signal rank: **#6 of 9** - Signal score: **0.67 / 1.00** - Best separating metric: **findings / file (0.85)** - Hit rate: **5/6 AI repos** vs **4/5 mature OSS repos** diff --git a/src/rules/promise-default-fallbacks/README.md b/src/rules/promise-default-fallbacks/README.md index b931fef..916cb4e 100644 --- a/src/rules/promise-default-fallbacks/README.md +++ b/src/rules/promise-default-fallbacks/README.md @@ -83,9 +83,10 @@ The file total is capped at `8`. ## Benchmark signal -Full pinned benchmark against the exact `known-ai-vs-solid-oss` cohort: +Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal score: **0.98 / 1.00** -- Best separating metric: **findings / file (0.99)** -- Hit rate: **9/9 AI repos** vs **4/9 mature OSS repos** -- Full results: [experimental rule report](../../../reports/autoresearch-candidate-rule.md#defensivepromise-default-fallbacks) +- Signal rank: **#1 of 9** +- Signal score: **0.81 / 1.00** +- Best separating metric: **findings / file (1.00)** +- Hit rate: **6/6 AI repos** vs **4/5 mature OSS repos** +- Full results: [rule signal report](../../../reports/rule-signal-mini.md#defensivepromise-default-fallbacks) diff --git a/src/rules/stringified-unknown-errors/README.md b/src/rules/stringified-unknown-errors/README.md index 1eea802..4c282da 100644 --- a/src/rules/stringified-unknown-errors/README.md +++ b/src/rules/stringified-unknown-errors/README.md @@ -71,9 +71,10 @@ The file total is capped at `8`. ## Benchmark signal -Full pinned benchmark against the exact `known-ai-vs-solid-oss` cohort: +Small pinned rule benchmark ([manifest](../../../benchmarks/sets/rule-signal-mini.json)): -- Signal score: **0.88 / 1.00** -- Best separating metric: **findings / file (0.88)** -- Hit rate: **7/9 AI repos** vs **1/9 mature OSS repos** -- Full results: [experimental rule report](../../../reports/autoresearch-candidate-rule.md#defensivestringified-unknown-errors) +- Signal rank: **#4 of 9** +- Signal score: **0.70 / 1.00** +- Best separating metric: **findings / file (0.80)** +- Hit rate: **4/6 AI repos** vs **1/5 mature OSS repos** +- Full results: [rule signal report](../../../reports/rule-signal-mini.md#defensivestringified-unknown-errors)