Conversation
There was a problem hiding this comment.
Pull request overview
This PR expands the Agentspecs catalog and documentation by introducing new spec categories (tools, teams, memory, guardrails, evals, triggers, outputs, notifications, hooks), adding many example YAML specs, and standardizing specs around explicit version: 0.0.1 plus versioned references (id:version) in several places. It also updates the Docusaurus site navigation to expose the new docs sections and bumps the Python package version.
Changes:
- Add new docs sections/pages for Tools, Teams, Memory, Guardrails, Evals, Triggers, Outputs, Notifications, Hooks, and Benchmarks; update navbar labels.
- Add many new YAML specs (triggers/tools/outputs/notifications/guardrails/evals/events/benchmarks/frontend-tools) and update many existing specs to include
version: 0.0.1and versioned references. - Add/refresh many example agent specs (including tool-approval and trigger demos) and bump
agentspecspackage version to0.0.4.
Reviewed changes
Copilot reviewed 189 out of 189 changed files in this pull request and generated 13 comments.
Show a summary per file
| File | Description |
|---|---|
| docs/README.md | Adds a short overview list of catalog coverage. |
| docs/docusaurus.config.js | Updates site title/tagline and expands navbar with new doc sections. |
| docs/docs/benchmarks/index.mdx | Adds documentation page for benchmark specs. |
| docs/docs/env-vars/category.yml | Renames category label to “Env Vars”. |
| docs/docs/env-vars/index.mdx | Adds version field docs and emphasizes versioned envvar references. |
| docs/docs/evals/category.yml | Adds evals category metadata. |
| docs/docs/evals/index.mdx | Adds documentation page for evaluator specs. |
| docs/docs/guardrails/category.yml | Adds guardrails category metadata. |
| docs/docs/guardrails/index.mdx | Adds documentation page for guardrail specs. |
| docs/docs/hooks/category.yml | Adds hooks category metadata. |
| docs/docs/hooks/index.mdx | Adds documentation page for lifecycle hooks. |
| docs/docs/mcp-servers/index.mdx | Adds version field docs and updates envvar examples. |
| docs/docs/memory/category.yml | Adds memory category metadata. |
| docs/docs/memory/index.mdx | Adds documentation page for memory specs. |
| docs/docs/models/index.mdx | Adds version field docs and updates model tables/examples. |
| docs/docs/notifications/category.yml | Adds notifications category metadata. |
| docs/docs/notifications/index.mdx | Adds documentation page for notification specs. |
| docs/docs/outputs/category.yml | Adds outputs category metadata. |
| docs/docs/outputs/index.mdx | Adds documentation page for output specs. |
| docs/docs/skills/index.mdx | Adds version field docs and updates envvar reference examples. |
| docs/docs/teams/category.yml | Adds teams category metadata. |
| docs/docs/teams/index.mdx | Adds documentation page for team specs. |
| docs/docs/tools/category.yml | Adds tools category metadata. |
| docs/docs/tools/index.mdx | Adds documentation page for tool specs. |
| docs/docs/triggers/category.yml | Adds triggers category metadata. |
| docs/docs/triggers/index.mdx | Adds documentation page for trigger specs. |
| agentspecs/version.py | Bumps package version to 0.0.4. |
| agentspecs/agents/analyze-campaign-performance.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/analyze-support-tickets.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/audit-inventory-levels.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/automate-regulatory-reporting.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/classify-route-emails.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/comprehensive-sales-analytics.yaml | Adds a new comprehensive sales analytics agent spec. |
| agentspecs/agents/crawler.yaml | Adds version, enables agent, adds versioned refs, adds frontend tools, sets trigger null. |
| agentspecs/agents/data-acquisition.yaml | Adds version, adds versioned refs, adds frontend tools, sets trigger null. |
| agentspecs/agents/demo-output.yaml | Adds new outputs demo agent spec. |
| agentspecs/agents/end-of-month-performance.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/eval-experiment-runner.yaml | Adds new eval experiment runner agent spec. |
| agentspecs/agents/example-codemode.yaml | Adds new codemode demo agent spec. |
| agentspecs/agents/example-evals-nocodemode.yaml | Adds new evals runner (no-codemode) agent spec. |
| agentspecs/agents/example-evals.yaml | Adds new evals runner agent spec. |
| agentspecs/agents/example-full.yaml | Adds new full demo agent spec (MCP + skills + approvals). |
| agentspecs/agents/example-guardrails.yaml | Adds new guardrails demo agent spec. |
| agentspecs/agents/example-inference.yaml | Adds new inference-provider demo agent spec. |
| agentspecs/agents/example-mcp.yaml | Adds new MCP demo agent spec. |
| agentspecs/agents/example-memory.yaml | Adds new memory (Mem0) demo agent spec. |
| agentspecs/agents/example-monitoring.yaml | Adds new monitoring demo agent spec. |
| agentspecs/agents/example-no-codemode.yaml | Adds new Tavily demo agent spec with codemode disabled. |
| agentspecs/agents/example-notifications.yaml | Adds new notifications demo agent spec. |
| agentspecs/agents/example-one-trigger-approval.yaml | Adds new once-trigger + approval demo agent spec. |
| agentspecs/agents/example-one-trigger.yaml | Adds new once-trigger demo agent spec. |
| agentspecs/agents/example-parameters.yaml | Adds new parameters (JSON schema) demo agent spec. |
| agentspecs/agents/example-simple.yaml | Renames simple agent ID, adds version, adds runtime tool + frontend tools, sets trigger null. |
| agentspecs/agents/example-skills.yaml | Adds new skills demo agent spec. |
| agentspecs/agents/example-subagents.yaml | Adds new subagents delegation demo agent spec. |
| agentspecs/agents/example-tool-approvals.yaml | Adds new tool approvals demo agent spec (hook configuration). |
| agentspecs/agents/example-otel.yaml | Adds new OTEL demo agent spec. |
| agentspecs/agents/extract-data-from-files.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/financial-viz.yaml | Adds version, adds versioned refs and frontend tools, sets trigger null. |
| agentspecs/agents/financial.yaml | Renames agent, adds version, adds versioned refs and frontend tools, sets trigger null. |
| agentspecs/agents/generate-weekly-reports.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/github-agent.yaml | Adds version, adds versioned refs and frontend tools, sets trigger null. |
| agentspecs/agents/information-routing.yaml | Adds version, adds versioned refs and frontend tools, sets trigger null. |
| agentspecs/agents/monitor-sales-kpis.yaml | Adds version, switches memory backend, adds runtime tools and advanced context config, adds trigger prompt. |
| agentspecs/agents/optimize-dynamic-pricing.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/optimize-grid-operations.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/process-citizen-requests.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/process-clinical-trial-data.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/process-financial-transactions.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/spatial-data-analysis.yaml | Adds new geospatial agent spec using Earthdata/Eurus MCP servers. |
| agentspecs/agents/summarize-documents.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt. |
| agentspecs/agents/sync-crm-contacts.yaml | Adds version, updates model/protocol, adds versioned refs and trigger prompt; removes embedded team block. |
| agentspecs/agents/codemode-paper/crawler.yaml | Removes old codemode-paper crawler spec. |
| agentspecs/agents/codemode-paper/data-acquisition.yaml | Removes old codemode-paper data-acquisition spec. |
| agentspecs/agents/codemode-paper/github-agent.yaml | Removes old codemode-paper github-agent spec. |
| agentspecs/agents/datalayer-ai/data-acquisition.yaml | Removes old datalayer-ai data-acquisition spec. |
| agentspecs/agents/datalayer-ai/simple.yaml | Removes old datalayer-ai simple spec. |
| agentspecs/benchmarks/agentbench.yaml | Adds AgentBench benchmark spec. |
| agentspecs/benchmarks/gpqa-diamond.yaml | Adds GPQA Diamond benchmark spec. |
| agentspecs/benchmarks/humaneval.yaml | Adds HumanEval benchmark spec. |
| agentspecs/benchmarks/mmlu.yaml | Adds MMLU benchmark spec. |
| agentspecs/benchmarks/swe-bench-verified.yaml | Adds SWE-bench Verified benchmark spec. |
| agentspecs/benchmarks/swe-bench.yaml | Adds SWE-bench benchmark spec. |
| agentspecs/benchmarks/toolbench.yaml | Adds ToolBench benchmark spec. |
| agentspecs/benchmarks/truthfulqa.yaml | Adds TruthfulQA benchmark spec. |
| agentspecs/envvars/ALPHAVANTAGE_API_KEY.yaml | Adds version to envvar spec. |
| agentspecs/envvars/GITHUB_TOKEN.yaml | Adds version to envvar spec. |
| agentspecs/envvars/GOOGLE_OAUTH_CLIENT_ID.yaml | Adds version to envvar spec. |
| agentspecs/envvars/GOOGLE_OAUTH_CLIENT_SECRET.yaml | Adds version to envvar spec. |
| agentspecs/envvars/HF_TOKEN.yaml | Adds version to envvar spec. |
| agentspecs/envvars/KAGGLE_TOKEN.yaml | Adds version to envvar spec. |
| agentspecs/envvars/SLACK_BOT_TOKEN.yaml | Adds version to envvar spec. |
| agentspecs/envvars/SLACK_CHANNEL_IDS.yaml | Adds version to envvar spec. |
| agentspecs/envvars/SLACK_TEAM_ID.yaml | Adds version to envvar spec. |
| agentspecs/envvars/TAVILY_API_KEY.yaml | Adds version to envvar spec. |
| agentspecs/events/agent-ended.yaml | Adds agent-ended event spec. |
| agentspecs/events/agent-started.yaml | Adds agent-started event spec. |
| agentspecs/events/tool-approval-requested.yaml | Adds tool-approval-requested event spec. |
| agentspecs/evals/contains.yaml | Adds “contains” evaluator spec. |
| agentspecs/evals/confusion-matrix-evaluator.yaml | Adds confusion-matrix evaluator spec. |
| agentspecs/evals/equals-expected.yaml | Adds equals-expected evaluator spec. |
| agentspecs/evals/equals.yaml | Adds equals evaluator spec. |
| agentspecs/evals/has-matching-span.yaml | Adds has-matching-span evaluator spec. |
| agentspecs/evals/is-instance.yaml | Adds is-instance evaluator spec. |
| agentspecs/evals/llm-judge.yaml | Adds LLM-judge evaluator spec. |
| agentspecs/evals/max-duration.yaml | Adds max-duration evaluator spec. |
| agentspecs/evals/precision-recall-evaluator.yaml | Adds precision/recall aggregate evaluator spec. |
| agentspecs/frontend-tools/jupyter-notebook.yaml | Adds frontend tool spec for Jupyter notebooks. |
| agentspecs/frontend-tools/lexical-document.yaml | Adds frontend tool spec for Lexical documents. |
| agentspecs/guardrails/data-engineering-power-user.yaml | Adds data engineering power-user guardrail spec. |
| agentspecs/guardrails/default-platform-user.yaml | Adds default platform user guardrail spec. |
| agentspecs/guardrails/github-actions-deploy.yaml | Adds GitHub Actions deploy guardrail spec. |
| agentspecs/guardrails/github-ci-bot.yaml | Adds GitHub CI bot guardrail spec. |
| agentspecs/guardrails/google-workspace-agent.yaml | Adds Google Workspace agent guardrail spec. |
| agentspecs/guardrails/restricted-viewer.yaml | Adds restricted viewer guardrail spec. |
| agentspecs/mcp-servers/alphavantage.yaml | Adds version and versioned envvar refs. |
| agentspecs/mcp-servers/chart.yaml | Adds version to MCP server spec. |
| agentspecs/mcp-servers/earthdata.yaml | Adds new Earthdata MCP server spec. |
| agentspecs/mcp-servers/eurus.yaml | Adds new Eurus MCP server spec. |
| agentspecs/mcp-servers/filesystem.yaml | Adds version to MCP server spec. |
| agentspecs/mcp-servers/github.yaml | Adds version and versioned envvar refs. |
| agentspecs/mcp-servers/google-workspace.yaml | Adds version and versioned envvar refs. |
| agentspecs/mcp-servers/huggingface.yaml | Adds version and versioned envvar refs. |
| agentspecs/mcp-servers/kaggle.yaml | Adds version and versioned envvar refs. |
| agentspecs/mcp-servers/salesforce.yaml | Adds version and versioned envvar refs. |
| agentspecs/mcp-servers/slack.yaml | Adds version and versioned envvar refs. |
| agentspecs/mcp-servers/tavily.yaml | Adds version and versioned envvar refs. |
| agentspecs/memory/ephemeral.yaml | Adds version to memory spec. |
| agentspecs/memory/mem0.yaml | Adds version to memory spec. |
| agentspecs/memory/memu.yaml | Adds version to memory spec. |
| agentspecs/memory/simplemem.yaml | Adds version to memory spec. |
| agentspecs/models/anthropic-claude-haiku-3-5.yaml | Adds version to model spec. |
| agentspecs/models/anthropic-claude-opus-4.yaml | Adds version to model spec. |
| agentspecs/models/anthropic-claude-sonnet-4-5.yaml | Adds version to model spec. |
| agentspecs/models/anthropic-claude-sonnet-4.yaml | Adds version to model spec. |
| agentspecs/models/azure-openai-gpt-4-1-mini.yaml | Adds version to model spec. |
| agentspecs/models/azure-openai-gpt-4-1-nano.yaml | Adds version to model spec. |
| agentspecs/models/azure-openai-gpt-4-1.yaml | Adds version to model spec. |
| agentspecs/models/azure-openai-gpt-4o-mini.yaml | Adds version to model spec. |
| agentspecs/models/azure-openai-gpt-4o.yaml | Adds version to model spec. |
| agentspecs/models/bedrock-claude-haiku-3-5.yaml | Removes Bedrock Claude Haiku 3.5 model spec. |
| agentspecs/models/bedrock-claude-opus-4-6.yaml | Adds version to model spec. |
| agentspecs/models/bedrock-claude-opus-4.yaml | Adds version to model spec. |
| agentspecs/models/bedrock-claude-sonnet-4-5.yaml | Adds version to model spec. |
| agentspecs/models/bedrock-claude-sonnet-4.yaml | Adds version to model spec. |
| agentspecs/models/openai-gpt-4-1-mini.yaml | Adds version to model spec. |
| agentspecs/models/openai-gpt-4-1-nano.yaml | Adds version to model spec. |
| agentspecs/models/openai-gpt-4-1.yaml | Adds version to model spec. |
| agentspecs/models/openai-gpt-4o-mini.yaml | Adds version to model spec. |
| agentspecs/models/openai-gpt-4o.yaml | Adds version to model spec. |
| agentspecs/models/openai-o3-mini.yaml | Adds version to model spec. |
| agentspecs/notifications/api-push.yaml | Adds API push notification spec. |
| agentspecs/notifications/email.yaml | Adds email notification spec. |
| agentspecs/notifications/slack.yaml | Adds Slack notification spec. |
| agentspecs/notifications/teams.yaml | Adds Teams notification spec. |
| agentspecs/notifications/webhook.yaml | Adds webhook notification spec. |
| agentspecs/outputs/csv.yaml | Adds CSV output spec. |
| agentspecs/outputs/dashboard.yaml | Adds dashboard output spec. |
| agentspecs/outputs/document.yaml | Adds document output spec. |
| agentspecs/outputs/email.yaml | Adds email output spec. |
| agentspecs/outputs/json.yaml | Adds JSON output spec. |
| agentspecs/outputs/notebook.yaml | Adds notebook output spec. |
| agentspecs/outputs/spreadsheet.yaml | Adds spreadsheet output spec. |
| agentspecs/skills/crawl.yaml | Adds version, updates module path, versioned envvar refs. |
| agentspecs/skills/events.yaml | Adds events skill spec. |
| agentspecs/skills/github.yaml | Adds version, updates module path, versioned envvar refs. |
| agentspecs/skills/jokes.yaml | Adds jokes skill spec. |
| agentspecs/skills/pdf.yaml | Adds version and updates module path. |
| agentspecs/skills/text-summarizer.yaml | Adds text-summarizer skill spec. |
| agentspecs/teams/analyze-campaign-performance.yaml | Adds team spec for campaign performance workflow. |
| agentspecs/teams/analyze-support-tickets.yaml | Adds team spec for support ticket analysis workflow. |
| agentspecs/teams/audit-inventory-levels.yaml | Adds team spec for inventory audit workflow. |
| agentspecs/teams/automate-regulatory-reporting.yaml | Adds team spec for regulatory reporting workflow. |
| agentspecs/teams/comprehensive-sales-analytics.yaml | Adds team spec for multi-agent sales analytics workflow. |
| agentspecs/teams/optimize-grid-operations.yaml | Adds team spec for grid operations optimization workflow. |
| agentspecs/teams/process-citizen-requests.yaml | Adds team spec for citizen requests workflow. |
| agentspecs/teams/process-clinical-trial-data.yaml | Adds team spec for clinical trial processing workflow. |
| agentspecs/teams/sync-crm-contacts.yaml | Adds team spec for CRM contact sync workflow. |
| agentspecs/tools/runtime-echo.yaml | Adds runtime echo tool spec. |
| agentspecs/tools/runtime-send-mail.yaml | Adds runtime send mail tool spec. |
| agentspecs/tools/runtime-sensitive-echo.yaml | Adds runtime sensitive echo tool spec. |
| agentspecs/triggers/event.yaml | Adds event trigger spec. |
| agentspecs/triggers/once.yaml | Adds once trigger spec. |
| agentspecs/triggers/schedule.yaml | Adds schedule trigger spec. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
+14
to
+18
| tags: | ||
| - sales | ||
| - crm | ||
| - data-sync | ||
| - deduplication |
Comment on lines
+16
to
+22
| tags: | ||
| - healthcare | ||
| - pharma | ||
| - clinical-trials | ||
| - patient-data | ||
| - compliance | ||
| enabled: true |
Comment on lines
+16
to
+23
| tags: | ||
| - government | ||
| - public-sector | ||
| - civic | ||
| - policy | ||
| - compliance | ||
| - transparency | ||
| enabled: true |
Comment on lines
+15
to
+22
| tags: | ||
| - energy | ||
| - utilities | ||
| - smart-grid | ||
| - iot | ||
| - predictive-maintenance | ||
| - sustainability | ||
| enabled: true |
Comment on lines
+16
to
+23
| tags: | ||
| - finance | ||
| - compliance | ||
| - regulatory | ||
| - risk | ||
| - banking | ||
| - audit | ||
| enabled: true |
Comment on lines
+17
to
+23
| tags: | ||
| - sales | ||
| - analytics | ||
| - kpi | ||
| - monitoring | ||
| - horizontal | ||
| enabled: true |
| envvars: | ||
| - OPENAI_API_KEY | ||
| - OPENAI_API_KEY:0.0.1 | ||
| - GITHUB_TOKEN |
| envvars: | ||
| - KAGGLE_TOKEN | ||
| - KAGGLE_TOKEN:0.0.1 | ||
| - GITHUB_TOKEN |
Comment on lines
+1
to
+3
| id: example-tool-approvals | ||
| version: 0.0.1 | ||
| name: Example Tool Approvals |
| - "Call runtime_sensitive_echo with reason 'read logs' and message 'hello approvals'." | ||
| - "Call runtime_sensitive_echo with reason 'delete project' and observe deny behavior from Python policy hook." | ||
| - "Call runtime_echo with any message to compare a non-sensitive tool path." | ||
| - "Use execute_code to print the latest lines from /tmp/agent_runtimes_tool_approvals_audit.jsonl." |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.