Make monit wait longer before thinking something is dead

monit

I'm trying to start a program (Resque) but it takes a bit of time before a pidfile is written. Thus, I think that Monit thinks the program hasn't started and starts one or two more programs before the before the pidfile of the first one is written.

How do I delay the time Monit checks again, just for this process? Or should I solve this in another way?

Best Answer

How do I delay the time Monit checks again, just for this process?

What you are trying to achieve could be done via "SERVICE POLL TIME" feature of monit

Monit documentation says

Services are checked in regular intervals given by the

set daemon n

statement. Checks are performed in the same order as they are written in the .monitrc file, except if dependencies are setup between services, in which case the services hierarchy may alternate the order of the checks.

One of the method to customize service poll is

custom interval based on poll cycle length multiple

EVERY [number] CYCLES

Example:

check process resque with pidfile /your/app/root/tmp/pid/resque.pid
   every 2 cycles

Or should I solve this in another way?

I also did initial attempt to monitor resque jobs with monit because monit is a very lightweight daemon but eventually settled with GOD. I know , I know GOD is more resource hungry in comparison to monit but in case of resque we found it to be a good match.

Related Solutions

Awaken monit daemon every few hours for all monitored processes

It's not necessary to monitor individual HP agents with Monit. Plus, they're all tied together with the wrapper service, hp-snmp-agents. Restarting one independently of the rest will have undesirable effects.

While it's possible to debug the HP agent logs, I think you may have an issue with your old kernel (looks like RHEL/CentOS 5.5) and possibly old HP management agents. The HP agents you should be using are at the SDR repository.

For the ProLiant DL3xx G7 platform, you'll need the newest version of the following packages:

hp-snmp-agents, hpssa, hp-health, hp-smh-templates, hpsmh, hpssacli, hponcfg

Docker – How to make Monit “check process” conditional inside docker based on docker run args

Sadly that is not how Monit is working.

Monit is there to react to states you define. If you use it as init system (what is totally fine and working) you have to have a config file that is built for your needs.

You could, however, try to hack it with a little sed or something.

The idea is to have a monitrc with all configs, but all inactive and activate them on first start. Like:

#check process foo with pidfile /run/foo.pid # proc-foo
#  onreboot nostart # proc-foo
#  mode passive # proc-foo

#check process bar with pidfile /run/bar.pid # proc-bar
#  onreboot nostart # proc-bar
#  mode passive # proc-bar

check program firststart path "/bin/bash -c /tmp/firststart.sh" # first-start

While /tmp/firststart.sh is something like:

#!/usr/bin/env bash

# Uncomment Lines Per Config:
[[ -n "${run_foo}" ]] && sed -i 's/^#\(.*\) # proc-foo$/\1/' /etc/monitrc
[[ -n "${run_bar}" ]] && sed -i 's/^#\(.*\) # proc-bar$/\1/' /etc/monitrc

# Delete FirstStart Line
sed -i '/^.*# first-start$/d' /etc/monitrc

# Force reload of monit config
kill -SIGHUP $(cat /run/monit.pid)

Best Answer

Related Solutions

Awaken monit daemon every few hours for all monitored processes

Docker – How to make Monit “check process” conditional inside docker based on docker run args

Related Topic