Summary
When a *_test.md file specifies a single user-step like "navigate to URL X, fill email, fill password, click Login", the kane-cli agent fragments it into 12+ internal steps. Each internal step burns ~10-30s and 3-6 credits.
Example trace
For a one-line "go to dev site and log in" objective, the agent ran:
- navigate → dev.lambdatestinternal.com
- cert warning Advanced
- cert warning Proceed
- wait (analyze if page loaded)
- wait (analyze again)
- wait (analyze if login form visible)
- analyze visual: is login form present?
- click email field
- fill email
- click password field
- fill password
- click Login button
- wait
- analyze URL fragment for
access_token=
- assert
For a 7-step test plan I authored, the agent expanded it to ~80+ internal steps and 200+ credits.
Observed behavior
- 7-step test_md → ~80 internal steps → 263 credits → 21 min wall time.
- A trivial single-step "log in and confirm Insights loaded" → ~15 internal steps → ~50 credits.
Suggested fixes
- Provide a primitive
login-like action that batches cert-bypass + form fill + submit + wait-for-redirect into one step.
- Recognize repeated form-fill patterns (click→fill→click→fill→submit) and collapse them.
- Cert-warning interstitial click-through trips the agent on every fresh run — surface a flag like
--auto-bypass-cert-warning to handle it without per-test steps.
Environment
- kane-cli 0.2.9
- macOS 14, Chrome 148
Summary
When a
*_test.mdfile specifies a single user-step like "navigate to URL X, fill email, fill password, click Login", the kane-cli agent fragments it into 12+ internal steps. Each internal step burns ~10-30s and 3-6 credits.Example trace
For a one-line "go to dev site and log in" objective, the agent ran:
access_token=For a 7-step test plan I authored, the agent expanded it to ~80+ internal steps and 200+ credits.
Observed behavior
Suggested fixes
login-like action that batches cert-bypass + form fill + submit + wait-for-redirect into one step.--auto-bypass-cert-warningto handle it without per-test steps.Environment