Skip to content

Pull requests: auth0/auth0-evals

New pull request New
22 Open 85 Closed
22 Open 85 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(reporter): do not drop judge reasoning on a leading newline
#107 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
refactor(reporter): hoist grade badge map and test gradeCssClass
#106 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
fix(cost): warn on unknown models and name the default pricing
#105 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
fix(reporter): validate and contextualize errors in loadScores
#104 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
fix(codex): measure real tool-call duration from item.started
#103 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
test(graders): cover event-grader predicate logic
#102 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
fix(runners): use makeSessionId for codex and gemini session ids
#101 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
test(core): cover detectRetry in classify.ts
#100 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
fix(graders): honor caseSensitive in the matches grader
#99 opened Jul 9, 2026 by frederikprijck Member Loading…
3 tasks done
1
fix(config): surface the underlying cause when config loading fails
#98 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
fix(graders): insert untrusted code verbatim in judge prompt
#97 opened Jul 9, 2026 by frederikprijck Member Loading…
1 task done
1
chore(lint): lint every workspace, not just the app
#96 opened Jul 9, 2026 by frederikprijck Member Loading…
4 tasks done
6
feat(graders): add calledTool and calledToolOneOf MCP trace graders
#95 opened Jul 9, 2026 by frederikprijck Member Loading…
4 tasks done
8
chore(deps): bump ai from 6.0.208 to 7.0.18 dependencies
#93 opened Jul 7, 2026 by dependabot Bot Loading…
chore(deps): bump @ai-sdk/openai from 3.0.74 to 4.0.9 dependencies
#88 opened Jul 7, 2026 by dependabot Bot Loading…
feat(cte): Custom Token Exchange tenant-config eval (CLI)
#84 opened Jul 6, 2026 by sanchitmehtagit Contributor Loading…
1
feat(mfa): MFA Leg 2 (tenant config: CLI)
#83 opened Jul 6, 2026 by sanchitmehtagit Contributor Loading…
1
feat(plumbing): hermetic mock Auth0 CLI + trace-aware judge for tenant-config evals
#82 opened Jul 6, 2026 by sanchitmehtagit Contributor Loading…
17
chore(deps): bump braintrust from 3.18.0 to 3.21.0 dependencies
#77 opened Jun 30, 2026 by dependabot Bot Loading…
feat(hosted-mcp): 32 evals for Auth0 hosted MCP server
#69 opened Jun 26, 2026 by lena-mohmand Loading…
3 tasks
feat(evals): add Custom Token Exchange × Next.js two-persona eval
#57 opened Jun 22, 2026 by brth31 Contributor • Draft
feat(mcp): add protected HTTP MCP server support
#47 opened Jun 16, 2026 by frederikprijck Member Loading…
3 of 4 tasks
11
ProTip! Updated in the last three days: updated:>2026-07-06.