Skip to content

Actions: SimulaMet/SimpleAudit

Actions

Tests

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
tests.yml
323 workflow runs
323 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Send judge_notes to the judge in SingleTurnAuditor; move three scoring notes in context_grounding Tests #327: Pull request #142 opened by avalyset
2m 12s avalyset:fix/single-turn-judge-notes
avalyset:fix/single-turn-judge-notes
2m 12s
Make optional checklist items in four packs read as optional under both the current and a wider rule Tests #326: Pull request #141 synchronize by avalyset
2m 4s avalyset:fix/optional-item-split
avalyset:fix/optional-item-split
2m 4s
Make optional checklist items in four packs read as optional under both the current and a wider rule Tests #325: Pull request #141 opened by avalyset
2m 10s avalyset:fix/optional-item-split
avalyset:fix/optional-item-split
2m 10s
chore: bump version to 0.5.1 Tests #324: Commit 01f4cb1 pushed by SushantGautam
2m 19s main
main
2m 19s
Judge target replies blocked by a safety filter; read all "Kan ..." checklist items as optional Tests #323: Pull request #140 opened by Robrusi
2m 17s fix/target-refusal-and-optional-items
fix/target-refusal-and-optional-items
2m 17s
Keep run meta on load, record scenario_pack in experiment runs, and handle a missing score in the README Tests #322: Pull request #139 opened by avalyset
1m 55s avalyset:fix/run-meta-followups
avalyset:fix/run-meta-followups
1m 55s
feat: log judge, target, and auditor model metadata in saved JSONs (#… Tests #321: Commit 007eaf4 pushed by SushantGautam
2m 10s main
main
2m 10s
feat: log judge, target, and auditor model metadata in saved JSONs Tests #320: Pull request #138 opened by SushantGautam
2m 6s fix/136-log-judge-target-meta
fix/136-log-judge-target-meta
2m 6s
Document the version and summary.ungraded keys in saved results Tests #319: Pull request #137 opened by avalyset
2m 7s avalyset:docs/readme-json-keys
avalyset:docs/readme-json-keys
2m 7s
Replace tracebacks with placeholder in core snapshots Tests #318: Commit bb73c98 pushed by SushantGautam
2m 8s main
main
2m 8s
Normalise traceback line numbers in core snapshots Tests #317: Commit cb644d7 pushed by SushantGautam
2m 0s main
main
2m 0s
Merge branch 'fix/judge-failures-as-error' of https://github.com/Simu… Tests #316: Commit f1322b0 pushed by SushantGautam
1m 59s main
main
1m 59s
Merge main into feat/digital-forvaltning-pack Tests #315: Commit 2d94173 pushed by SushantGautam
2m 14s main
main
2m 14s
Add brreg_registre: seven scenarios on the Brønnøysund registers (#133) Tests #314: Commit 89770a1 pushed by SushantGautam
1m 51s main
main
1m 51s
Record a format version in AuditResults.to_dict() (#132) Tests #313: Commit 3dee975 pushed by SushantGautam
1m 54s main
main
1m 54s
Report judge failures as ERROR instead of inventing a grade Tests #312: Pull request #135 synchronize by SushantGautam
2m 33s fix/judge-failures-as-error
fix/judge-failures-as-error
2m 33s
Don't score provider failures; fix OpenRouter TypeError and empty rep… Tests #311: Commit fac2c0b pushed by SushantGautam
2m 3s main
main
2m 3s
Report judge failures as ERROR instead of inventing a grade Tests #310: Pull request #135 opened by Robrusi
2m 42s fix/judge-failures-as-error
fix/judge-failures-as-error
2m 42s
Add digdir_digital_forvaltning: seven scenarios on digital public administration Tests #309: Pull request #134 opened by avalyset
1m 48s avalyset:feat/digital-forvaltning-pack
avalyset:feat/digital-forvaltning-pack
1m 48s
Add brreg_registre: seven scenarios on the Brønnøysund registers Tests #308: Pull request #133 synchronize by avalyset
2m 6s avalyset:feat/brreg-registre-pack
avalyset:feat/brreg-registre-pack
2m 6s
Add brreg_registre: seven scenarios on the Brønnøysund registers Tests #307: Pull request #133 opened by avalyset
1m 56s avalyset:feat/brreg-registre-pack
avalyset:feat/brreg-registre-pack
1m 56s
Record a format version in AuditResults.to_dict() Tests #306: Pull request #132 opened by avalyset
2m 2s avalyset:feat/audit-results-format-version
avalyset:feat/audit-results-format-version
2m 2s
Merge remote-tracking branch 'origin/main' into sync/main-into-dev Tests #305: Commit 543e6ca pushed by SushantGautam
3m 3s dev
dev
3m 3s
DecisionTarget: optional client reuse and retries (#131) Tests #304: Commit 9cdb464 pushed by SushantGautam
3m 21s dev
dev
3m 21s
Add ASR and decision audit examples (#118) Tests #303: Commit d40a6b8 pushed by SushantGautam
3m 23s main
main
3m 23s