Deterministic security benchmark for tool-using AI agents
-
Updated
Jul 16, 2026 - Python
#
security-benchmark
Here are 8 public repositories matching this topic...
Vendor-neutral benchmark measuring how MCP security proxies/gateways DEFEND against 22+ attack vectors — crosswalked to NIST AI RMF & OWASP LLM/Agentic Top 10. CI-gated, reproducible, DOI-cited. Submit your tool to the leaderboard.
benchmark mcp evaluation ai-security prompt-injection llm-security agentic-ai model-context-protocol nist-ai-rmf security-benchmark tool-poisoning owasp-llm-top10 owasp-agentic
-
Updated
Jul 21, 2026 - JavaScript
ReplayBench-IoT: reproducible IoT replay-defense benchmark with Monte Carlo sweeps, CI, static demo, and hardware-validation artifacts.
python reproducible-research nextjs monte-carlo-simulation iot-security network-security challenge-response replay-attack sliding-window wireless-security fastapi oscore security-benchmark
-
Updated
Jun 26, 2026 - Python
Product-security LLM benchmark harness for realistic AppSec, supply-chain, and LLM application security evaluations.
benchmark owasp application-security appsec ai-security product-security supply-chain-security llm security-benchmark
-
Updated
May 25, 2026 - Python
Open AI-for-security validation benchmark: non-LLM scorer + a SOTA-validation loop. Labeled positive corpus withheld pending coordinated disclosure.
evaluation vulnerability-detection ai-security ml-security llm-security agent-security security-benchmark cwe-862
-
Updated
Jun 18, 2026 - Python
FreightSkillBench is a reproducible benchmark for evaluating document-to-transaction integrity, prompt-injection risk, and security controls in AI-enabled shipping and logistics workflows.
reproducible-research edi critical-infrastructure ai-agents document-processing transportation-management-system supply-chain-security electronic-data-interchange large-language-models benchmark-dataset prompt-injection llm-security agent-security adversarial-testing freight-logistics transportation-security security-benchmark indirect-prompt-injection logistics-cybersecurity transaction-integrity
-
Updated
Jul 12, 2026 - Python
GitHub action for Maester
security automation pipeline powershell hacktoberfest microsoft-teams exchange-online microsoftteams m365 exchangeonline security-assessment microsoft-365 entra-id entraid security-benchmark
-
Updated
Apr 29, 2026 - PowerShell
The core repository for the Maester module with helper cmdlets that will be called from the Pester tests.
security automation powershell hacktoberfest microsoft-teams exchange-online microsoftteams m365 exchangeonline security-assessment microsoft-365 entra-id entraid security-benchmark
-
Updated
Jul 13, 2026 - HTML
Improve this page
Add a description, image, and links to the security-benchmark topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the security-benchmark topic, visit your repo's landing page and select "manage topics."