[GH-ISSUE #144] Reverse healthcheck - Signal #98

Closed
opened 2026-02-25 23:41:10 +03:00 by kerem · 7 comments
Owner

Originally created by @Braintelligence on GitHub (Dec 27, 2017).
Original GitHub issue: https://github.com/healthchecks/healthchecks/issues/144

Hi everyone!
Is there a way to set up kind of a "reverse" healthcheck? Like, not watch a regularly incoming ping but rather a single ping that is meant as a warning-trigger?

For example I have a machine that I am monitoring by pinging every 5 minutes but I also want it to be able to ping me when it rebooted for some reason only once, and by doing so, triggering a warning.

So instead of a "ping regularly for relaxation" I want to be able to "ping once for danger".

Is this possible?

Originally created by @Braintelligence on GitHub (Dec 27, 2017). Original GitHub issue: https://github.com/healthchecks/healthchecks/issues/144 Hi everyone! Is there a way to set up kind of a "reverse" healthcheck? Like, not watch a regularly incoming ping but rather a single ping that is meant as a warning-trigger? For example I have a machine that I am monitoring by pinging every 5 minutes but I also want it to be able to ping me when it rebooted for some reason only once, and by doing so, triggering a warning. So instead of a "ping regularly for relaxation" I want to be able to "ping once for danger". Is this possible?
kerem closed this issue 2026-02-25 23:41:10 +03:00
Author
Owner

@cuu508 commented on GitHub (Dec 27, 2017):

This is an interesting use case.

There is no specific support for it, but you can use the regular checks and it sort of works: set up a new check, and set its period and grace time both to 1 minute. Its normal, default state will be "down". And it will flip to "up" for a short time each time it is pinged.

When you ping this check, you will immediately get a "[name of the check] is UP". Two minutes later you will get "[name of the check] is DOWN". Each time you see this pair of messages you will know the machine had rebooted.

If you send a ping during a shutdown, you could name the check "Machine Shutdown Process". And if you call it during boot, name the check "Machine Boot-up" so the wording in notifications makes at least some sense...

It's not ideal that you would be getting two notifications, and the wording in the notifications also would not be the clearest, but this is something you can use today.

<!-- gh-comment-id:354127516 --> @cuu508 commented on GitHub (Dec 27, 2017): This is an interesting use case. There is no specific support for it, but you can use the regular checks and it sort of works: set up a new check, and set its period and grace time both to 1 minute. Its normal, default state will be "down". And it will flip to "up" for a short time each time it is pinged. When you ping this check, you will immediately get a "[name of the check] is UP". Two minutes later you will get "[name of the check] is DOWN". Each time you see this pair of messages you will know the machine had rebooted. If you send a ping during a shutdown, you could name the check "Machine Shutdown Process". And if you call it during boot, name the check "Machine Boot-up" so the wording in notifications makes at least some sense... It's not ideal that you would be getting two notifications, and the wording in the notifications also would not be the clearest, but this is something you can use today.
Author
Owner

@Braintelligence commented on GitHub (Dec 27, 2017):

Actually the machine doesn't shutdown properly when this happens.
To be more precise: I have machines running unstable applications, that MAY just crash at some point. When this happens they just reboot but they don't restart the processes by themselves (which is wanted this way).

So I want to know if they run properly after their processes were started by hand and I want to know ASAP when they rebooted by themselves.

Your hint was great, I'll incorporate it!

<!-- gh-comment-id:354128123 --> @Braintelligence commented on GitHub (Dec 27, 2017): Actually the machine doesn't shutdown properly when this happens. To be more precise: I have machines running unstable applications, that MAY just crash at some point. When this happens they just reboot but they don't restart the processes by themselves (which is wanted this way). So I want to know if they run properly after their processes were started by hand and I want to know ASAP when they rebooted by themselves. Your hint was great, I'll incorporate it!
Author
Owner

@Braintelligence commented on GitHub (Dec 27, 2017):

(Though it would be really cool if we had the option to create such "signals" as well in the future 😸)

<!-- gh-comment-id:354128370 --> @Braintelligence commented on GitHub (Dec 27, 2017): (Though it would be really cool if we had the option to create such "signals" as well in the future 😸)
Author
Owner

@Braintelligence commented on GitHub (Dec 27, 2017):

Oh and as another possible enhancement:
If there are green checks for a tag and also red checks for a tag, then I'd like for the check-tag to be yellow instead of red, so I'd know that SOME stuff is working, while others is not.

<!-- gh-comment-id:354130706 --> @Braintelligence commented on GitHub (Dec 27, 2017): Oh and as another possible enhancement: If there are green checks for a tag and also red checks for a tag, then I'd like for the check-tag to be yellow instead of red, so I'd know that SOME stuff is working, while others is not.
Author
Owner

@cuu508 commented on GitHub (Dec 27, 2017):

If there are green checks for a tag and also red checks for a tag, then I'd like for the check-tag to be yellow instead of red, so I'd know that SOME stuff is working, while others is not.

Are you thinking of the tags in "My Checks" screen or the badges in Account > Badges?

For the latter, I've had an idea about optionally showing the badges like this:

[production | 5 up | 2 down]

instead of just

[production | up] 

or

[production | down]
<!-- gh-comment-id:354131954 --> @cuu508 commented on GitHub (Dec 27, 2017): > If there are green checks for a tag and also red checks for a tag, then I'd like for the check-tag to be yellow instead of red, so I'd know that SOME stuff is working, while others is not. Are you thinking of the tags in "My Checks" screen or the badges in Account > Badges? For the latter, I've had an idea about optionally showing the badges like this: [production | 5 up | 2 down] instead of just [production | up] or [production | down]
Author
Owner

@Braintelligence commented on GitHub (Dec 27, 2017):

On the "My Checks" part, where below the checks are listed.

Showing the tags like you proposed would be even better. This way I could have something like:

[rebooted | 5 down]

Then if I have 5 machines, I know none have rebooted in the last X timeframe.

<!-- gh-comment-id:354132193 --> @Braintelligence commented on GitHub (Dec 27, 2017): On the "My Checks" part, where below the checks are listed. Showing the tags like you proposed would be even better. This way I could have something like: ``` [rebooted | 5 down] ``` Then if I have 5 machines, I know none have rebooted in the last X timeframe.
Author
Owner

@cuu508 commented on GitHub (Aug 20, 2018):

I've been playing around with the badge styling, trying to incorporate the "5 down" bit in them. It's not easy to add the extra information without making the tags area look busy and noisy. Especially for accounts that use dozens of tags. So for now I'll leave the tag area as-is.

PS. There have been a couple related changes & improvements though:

  • Failed checks are always shown at top, so they are easy to notice
  • The page title shows "X down" if any checks are down. The title does auto-refresh
  • Filtering by tags was semi broken but works correctly now. If any tag is red, you can click on it and easily see all matching checks.

PPS. On the original issue about triggering failures, that's been implemented, check out "Signalling a Failure" in https://healthchecks.io/docs/

<!-- gh-comment-id:414261729 --> @cuu508 commented on GitHub (Aug 20, 2018): I've been playing around with the badge styling, trying to incorporate the "5 down" bit in them. It's not easy to add the extra information without making the tags area look busy and noisy. Especially for accounts that use dozens of tags. So for now I'll leave the tag area as-is. PS. There have been a couple related changes & improvements though: * Failed checks are always shown at top, so they are easy to notice * The page title shows "X down" if any checks are down. The title does auto-refresh * Filtering by tags was semi broken but works correctly now. If any tag is red, you can click on it and easily see all matching checks. PPS. On the original issue about triggering failures, that's been implemented, check out "Signalling a Failure" in https://healthchecks.io/docs/
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/healthchecks#98
No description provided.