Skip to content

Add repeated trials and stability scoring #47

Description

@askmy-stack

Summary

Support repeated model-backed probe trials and summarize result stability.

Acceptance criteria

  • Trial count is configurable and defaults conservatively
  • Results retain per-trial details and aggregate summary
  • Stability score accounts for tool selection and argument validity
  • Reports highlight unstable probes separately from deterministic failures
  • Seed/configuration metadata is recorded when the provider supports it
  • Tests cover stable, unstable, and partial-failure runs

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:probesbehavioral contractsenhancementNew feature or requestpriority:p1Next product — M1 remainder + M3/M4 startresearchOpen-ended or experimental work

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions