Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  Accelerator
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

parameterlab / MASEval Public

Notifications You must be signed in to change notification settings
Fork 7
Star 17

Code
Issues 4
Pull requests 1
Actions
Projects
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Actions
Projects
Security
Insights

GAIA2 and MultiAgentBench Fixes#30

Draft

cemde wants to merge 53 commits intomainparameterlab/MASEval:mainfrom

fix-benchmarksparameterlab/MASEval:fix-benchmarksCopy head branch name to clipboard

Conversation Commits53 (53)Checks Files changed

Draft

GAIA2 and MultiAgentBench Fixes#30
cemde wants to merge 53 commits intomainfrom
fix-benchmarks

Commits

Commits on Feb 5, 2026

initial fix of werewolf
cemde
committed
added fixes for multiagentbench
cemde
committed
added dependency overwrite for ARE due to pinned dependencies
cemde
committed
fixed gaia2 implementation
cemde
committed

Commits on Feb 6, 2026

updated pining in multiagentbench
cemde
committed
added optional dependency for multiagentbench
cemde
committed
updated optional dependencies
cemde
committed
fixed multiagentbench tests
cemde
committed
simplified installs with extras for all benchmarks
cemde
committed
[skip ci] updated lockfile
cemde
committed
[skip ci] fixed dependency
cemde
committed
attempt at fix of dependency issues
cemde
committed
another attemt to fix dependencies
cemde
committed
changed vendoring of multiagentbench to my own fork
cemde
committed
fix bug in GAIA2
cemde
committed
fixed multiagentbench fallbacks
cemde
committed

Commits on Feb 9, 2026

fixed tools for gaia2
cemde
committed
fixed gaia2 bugs
cemde
committed
more bug fixes
cemde
committed

Commits on Feb 10, 2026

updated agents file
cemde
committed
condensed default instructions
cemde
committed
default example
cemde
committed
updated agents file
cemde
committed
fixes file added.
cemde
committed
added fixes to gaia2 that increase faithfulness to original implementation
cemde
committed
added bug report for multiagentbench
cemde
committed
updated gaia eval
cemde
committed
fixed gaia2 evaluator
cemde
committed

Commits on Feb 11, 2026

fixed bug in evaluators
cemde
committed
Merge remote-tracking branch 'origin/main' into fix-benchmarks
cemde
committed
fixed benchmarks
cemde
committed
added testing plan
cemde
committed
fixed tests
cemde
committed
fixed tests
cemde
committed
removed testing cache
cemde
committed

Commits on Feb 12, 2026

fixed missing intiialization bug for tau2 bench
cemde
committed
fixed typing errors
cemde
committed
fix Multiagentbench bug where results are not trunacted properly causing LLM contextlength overflow
cemde
committed
fixed tools in tau2
cemde
committed
gaia2 typing fix
cemde
committed
fixed data loading bug in gaia2
cemde
committed
fixed bug in tau2 implementation
cemde
committed
fixed gaia2 docstring
cemde
committed
fixed testing of marble
cemde
committed
fixed testing errors
cemde
committed
small fix for tau2 implementation now printing tool results better into agent messages
cemde
committed

Commits on Feb 13, 2026

fixed tests for marble and pytest misconfiguration
cemde
committed
fixed Gaia2 evaluator config
cemde
committed
proposed fix for gaia2 notification management
cemde
committed
bug fix for gaia2 notifcation pulling
cemde
committed
[skip ci] fixed comment formatting
cemde
committed
fixed stop token usage
cemde
committed
[skip ci] fixed gaia2 docs
cemde
committed

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.