Skip to content

Add task-aware policy review with prover and JEV MCP services - #79

Open
johnnygreco wants to merge 7 commits into
mainfrom
johnny/jev-policy-mcp-demo
Open

johnnygreco wants to merge 7 commits into
mainfrom
johnny/jev-policy-mcp-demo

Conversation

@johnnygreco

Copy link
Copy Markdown
Collaborator

Adds a task-aware OpenShell policy review demo with two independent stdio MCP services: an external prover checks whether a candidate stays within an operator-owned boundary, and TypeSafe JEV assesses whether supported permissions fit the delegated task. The ordered demo calls JEV only after a successful boundary check and combines reports only when candidate fingerprints match.

The JEV review resolves custom-question pointers into model-visible values, distinguishes excessive write scope from unnecessary write access, exposes typed nested MCP inputs, and preserves ambiguous answers as incomplete, non-actionable assessments. Unsupported nested controls are recorded as unassessed. YAML traversal and request sizes are bounded, including starting policies and complete review payloads.

Includes configuration examples, scenario fixtures, regression tests, and a live evaluation record. Neither service edits or activates policies.

Validation:

  • 23 tests passed; five external-prover tests skipped because openshell-prover was unavailable.
  • Ruff lint and formatting passed.
  • Live jev-1.13.0 request succeeded.
  • Stdio MCP initialization, tool discovery, and live review invocation succeeded with HTTP 200.
  • The full ordered prover-then-JEV runner remains unverified in this environment because the prover executable is unavailable.

Closes #78.

@github-actions

github-actions Bot commented Sep 21, 2026 •

Copy link
Copy Markdown

New project review

Revision: 681b8c8d9578d1b6f7b3abee13091d8e50063aeb 路 Workflow and result artifacts

Review findings are advisory. Required checks remain separate merge gates.

Execution: skipped

Reviewer and guidelines revision: 39e7a59340937d8ea852191d6e1227ac1967f83a

Warning

Live OAR review was manually bypassed. No verdict was produced; this is not a passing review.
PR label skip-oar-live.

Projects not reviewed:

  • projects/use-case-examples/policy-review-mcp

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Build task-aware policy review with Prover and JEV MCP services

1 participant