Skip to content

📈 Add Rudder-specific usage telemetry - #93

Merged
Vivekyy merged 5 commits into
mainfrom
Vivekyy/add-enhanced-telemetry
Jul 30, 2026
Merged

📈 Add Rudder-specific usage telemetry#93
Vivekyy merged 5 commits into
mainfrom
Vivekyy/add-enhanced-telemetry

Conversation

@Vivekyy

@Vivekyy Vivekyy commented Jul 30, 2026

Copy link
Copy Markdown
Collaborator

Adds privacy-preserving Rudder lifecycle telemetry for captured intent, context snapshots, test backups, generated-test scope, behavioral questions, and verified run outcomes without collecting raw prompts or generic model, token, tool, or cost data.

Repository, branch, and run identifiers are pseudonymized with a local secret; canonical DO_NOT_TRACK=1 remains a hard gate and telemetry remains best-effort.

Rudder helpers and workflow instructions now carry run IDs, back up untracked tests, measure test-line snapshots, and report completion metrics.

The diff coverage threshold is now 90%, with npm run typecheck, all 41 tests, and npm run build passing.


Open in Stage

Greptile Summary

Adds privacy-preserving, pseudonymized Rudder lifecycle telemetry.

  • Adds run, context-refresh, backup, question, and completion events.
  • Extends prompt telemetry with session and reconciliation metadata.
  • Adds local telemetry identity/key persistence and preserves the DO_NOT_TRACK gate.
  • Updates skill helpers, workflow instructions, packaging tests, and coverage requirements.

Confidence Score: 4/5

The base-ref handoff needs to be fixed before merging so completion telemetry cannot be lost or measured against a different scope from the run.

The initial helper may resolve an omitted base automatically, but the workflow retains only the run ID while later helpers require a base argument and recompute metrics from it.

Files Needing Attention: skills/rudder/SKILL.md, skills/rudder/scripts/telemetry.mjs

Important Files Changed

Filename Overview
skills/rudder/SKILL.md Adds lifecycle telemetry instructions but does not preserve the resolved base required for consistent later measurements.
skills/rudder/scripts/telemetry.mjs Implements lifecycle event dispatch and completion metrics, relying on callers to provide the correct base ref.
skills/rudder/scripts/context.mjs Generates run IDs and reports pseudonymized scope metrics using its resolved merge base.
src/rudder-telemetry.ts Defines and validates the privacy-limited Rudder telemetry event schemas.
src/telemetry.ts Adds installation-scoped HMAC pseudonymization, schema metadata, and restricted identity persistence.
src/prompt-hook.ts Adds session-level prompt and branch-reconciliation telemetry while retaining best-effort capture behavior.

Sequence Diagram

sequenceDiagram
    participant Agent
    participant Context as context.mjs
    participant Backup as backup-tests.mjs
    participant Complete as telemetry.mjs
    participant Hook as rudder-prompt-hook
    Agent->>Context: start [--base target-ref]
    Context-->>Agent: rudderRunId, baseRef, mergeBase
    Agent->>Backup: runId + target-ref
    Backup->>Hook: test-backup-created
    Agent->>Complete: runId + target-ref + outcome
    Complete->>Hook: run-finished
    Note over Agent,Complete: Later calls must reuse Context's resolved baseRef
Loading

Fix All in Cursor Fix All in Conductor

Reviews (1): Last reviewed commit: "📈 Add Rudder usage telemetry" | Re-trigger Greptile

Greptile also left 1 inline comment on this PR.

Co-authored-by: Codex Agent <codex@openai.com>
@github-actions

Copy link
Copy Markdown

📦 No plugin release on merge

The plugin package, tag, and GitHub Release already exist for 0.1.3.
Bump package.json to release a new plugin version.

@ghost

ghost commented Jul 30, 2026

Copy link
Copy Markdown

Ready to review this PR? Stage has broken it down into 6 individual chapters for you:

Title
1 Enhance core telemetry with pseudonymization and identity
2 Define Rudder-specific usage telemetry schemas
3 Extend prompt hook for Rudder session telemetry
4 Implement Rudder skill telemetry helpers
5 Update Rudder workflow instructions
6 Verify skill runtime and packaging
Open in Stage

Chapters generated by Stage for commit 0897ce6 on Jul 30, 2026 4:43pm UTC.

Comment thread skills/rudder/SKILL.md Outdated
Vivekyy and others added 4 commits July 30, 2026 12:28
Co-authored-by: Codex Agent <codex@openai.com>
Co-authored-by: Codex Agent <codex@openai.com>
Co-authored-by: Codex Agent <codex@openai.com>
@Vivekyy
Vivekyy merged commit 58faab0 into main Jul 30, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant