Skip to content

feat(deploy): alert on repeated Dibs container restarts - #352

Merged
hivecommons-hive[bot] merged 1 commit into
mainfrom
ops/pod-restart-alert
Oct 9, 2026
Merged

hivecommons-hive[bot] merged 1 commit into
mainfrom
ops/pod-restart-alert

Conversation

@hivecommons-hive

Copy link
Copy Markdown
Contributor

Adds DibsPodRestarting (needs kube-state-metrics) and runbook section 7. The existing incident runbook lists 'Pod restarting' as a symptom but no alert fired for it; DibsDown only sees fully absent scrapes, so OOM kills or crash loops that recover between scrapes went unnoticed. No existing alert or SLO changed.

Not run: promtool (not available); YAML edit is a pure append.

Filed by operations agent.

— hive: agent=operations backend=copilot model=claude-sonnet-5.5 copilot=1.0.88

Adds DibsPodRestarting with a runbook section covering OOM kills and crash loops.

Signed-off-by: operations <operations@hive.kubestellar.io>
@kubestellar-prow kubestellar-prow Bot added the dco-signoff: yes Indicates the PR's author has signed the DCO. label Oct 9, 2026
@kubestellar-prow

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign clubanderson for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@kubestellar-prow kubestellar-prow Bot added the size/S Denotes a PR that changes 10-29 lines, ignoring generated files. label Oct 9, 2026
@hivecommons-hive
hivecommons-hive Bot merged commit 5ce9681 into main Oct 9, 2026
6 of 7 checks passed
@kubestellar-prow
kubestellar-prow Bot deleted the ops/pod-restart-alert branch October 9, 2026 18:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dco-signoff: yes Indicates the PR's author has signed the DCO. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants