Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Zoo-Code-Org
Zoo-Code
Repository navigation
Code
Issues
689
(689)
Pull requests
168
(168)
Discussions
Actions
Projects
Security and quality
Insights
More
items
feat(evals): add coding-task evaluation framework (#2084)
- #2154
#2154
Open
edelauna
wants to merge 22 commits into
main
Zoo-Code-Org/Zoo-Code:main
from
issue/2084
Zoo-Code-Org/Zoo-Code:issue/2084
Copy head branch name to clipboard
Conversation
Commits
22
(22)
Checks
Files changed
Open
feat(evals): add coding-task evaluation framework (#2084)
#2154
edelauna
wants to merge 22 commits into
main
Zoo-Code-Org/Zoo-Code:main
from
issue/2084
Zoo-Code-Org/Zoo-Code:issue/2084
Copy head branch name to clipboard
Commits
Commits on Nov 5, 2026
feat(evals): add coding-task evaluation framework (#2084)
edelauna
committed
f69baee
View commit details
Copy full SHA for f69baee
Browse repository at this point
fix(evals): secure coding comparisons and correct grading and cost accounting
edelauna
committed
f49cdb2
View commit details
Copy full SHA for f49cdb2
Browse repository at this point
fix(evals): enforce trust checks and reliable comparison cleanup and reports
edelauna
committed
95a525c
View commit details
Copy full SHA for 95a525c
Browse repository at this point
fix(evals): pass test fixture paths as arguments instead of embedding code
edelauna
committed
bb1758c
View commit details
Copy full SHA for bb1758c
Browse repository at this point
fix(evals): enforce isolated grading and safe interruption and result writes
edelauna
committed
12794d7
View commit details
Copy full SHA for 12794d7
Browse repository at this point
fix(agent-evals): reject dirty checkouts and clear stale grader digests
edelauna
committed
4f0e44e
View commit details
Copy full SHA for 4f0e44e
Browse repository at this point
fix(agent-evals): prevent child startup after interruption and preserve signal exit codes
edelauna
committed
d26ad55
View commit details
Copy full SHA for d26ad55
Browse repository at this point
fix(agent-evals): detect dirty checkouts despite Git settings that hide changes
edelauna
committed
02ce7ff
View commit details
Copy full SHA for 02ce7ff
Browse repository at this point
fix(agent-evals): isolate side builds and invalidate stale results before artifacts
edelauna
committed
980095b
View commit details
Copy full SHA for 980095b
Browse repository at this point
fix(evals): wait for preparation cleanup after repeated interrupts
edelauna
committed
8210012
View commit details
Copy full SHA for 8210012
Browse repository at this point
fix(evals): address review feedback on isolation, cleanup, and reports
edelauna
committed
9028fde
View commit details
Copy full SHA for 9028fde
Browse repository at this point
fix(evals): address review feedback on isolation, cleanup, and reports
edelauna
committed
9fd42e9
View commit details
Copy full SHA for 9fd42e9
Browse repository at this point
fix(evals): close review gaps in cleanup and run accounting
edelauna
committed
fceb8a7
View commit details
Copy full SHA for fceb8a7
Browse repository at this point
fix(evals): bind grader images and isolate host caches
edelauna
committed
6f381c8
View commit details
Copy full SHA for 6f381c8
Browse repository at this point
fix(evals): clean up partial side publication on failure
edelauna
committed
87901d1
View commit details
Copy full SHA for 87901d1
Browse repository at this point
fix(agent-evals): prevent credential leaks to grading subprocesses
edelauna
committed
801c43a
View commit details
Copy full SHA for 801c43a
Browse repository at this point
fix(evals): probe container engines and preserve Docker endpoint settings
edelauna
committed
3ce847d
View commit details
Copy full SHA for 3ce847d
Browse repository at this point
Commits on Nov 6, 2026
fix(evals): qualify grader image and test output permissions
edelauna
committed
a17059b
View commit details
Copy full SHA for a17059b
Browse repository at this point
fix(evals): address review feedback and failing CI assertions
edelauna
committed
42788a0
View commit details
Copy full SHA for 42788a0
Browse repository at this point
Commits on Nov 7, 2026
fix(evals): reuse verified private VS Code cache and preserve proxy settings
edelauna
committed
3c26401
View commit details
Copy full SHA for 3c26401
Browse repository at this point
fix(evals): disable host commands and lock comparison output
edelauna
committed
e0427c6
View commit details
Copy full SHA for e0427c6
Browse repository at this point
test(evals): verify disabled commands are blocked at dispatch
edelauna
committed
958fdac
View commit details
Copy full SHA for 958fdac
Browse repository at this point
You can’t perform that action at this time.
