Totmannschalter
Totmannschalter (German for dead man's switch) is a simple service that notifies you when it has not received any message from a service for a period of time. It is provided free to use by the German health insurance BKK VBU.
Usage
Currently, only Slack integration is supported.
- Create a Slack webhook: https://api.slack.com/messaging/webhooks. It's important to use one dedicated webhook per Prometheus instance, as the webhook is used to keep track of which services have not sent a request recently. The webhook will have a format like https://hooks.slack.com/services/Tttttttt/Bbbbbbb/Xxxxxxxxx
- Regularly send a HTTP POST request to https://totmannschalter.com/slack/Tttttttt/Bbbbbbb/Xxxxxxxxx using the last three parts of the webhook from step 1. The request body is ignored.
- If no request was received for 5 minutes, Totmannschalter will send a one-time message via the Slack webhook like this:
Prometheus / Alertmanager integration
If you are using Prometheus and Alertmanager, you can use Totmannschalter like the following.
Add a PrometheusRule:
apiVersion: monitoring.coreos.com/v1
kind: PrometheusRule
metadata:
name: totmannschalter
spec:
groups:
- name: Watchdog
rules:
- alert: Watchdog
expr: vector(1)
labels:
notification: totmannschalter
Add to alertmanager.yaml:
route:
routes:
- match:
notification: totmannschalter
receiver: totmannschalter
repeat_interval: 2m
receivers:
- name: totmannschalter
webhook_configs:
- url: "https://totmannschalter.com/slack/Tttttttt/Bbbbbbb/Xxxxxxxxx"
1 Nov 8, 2022
2 Jan 12, 2022
2.5k Jan 3, 2023
18 Dec 31, 2022
14 May 31, 2022
0 Aug 31, 2022
2 Nov 24, 2021
7 Sep 28, 2021
73 Dec 14, 2022
3 Sep 30, 2022
195 Dec 13, 2022
2 Mar 1, 2022
19 Jun 3, 2021
2 Oct 18, 2021
1 Nov 2, 2021
1 Nov 3, 2021
2 Nov 11, 2021
1 Dec 5, 2021
4 Sep 13, 2021