Page MenuHomePhabricator
Create Task
Maniphest T50668

Set up Icinga monitoring for grid
Closed, DuplicatePublic
Actions

Description

Besides the Ganglia statistics, the grid's status should be properly monitored and alarms set up. From the top of my head and without data to back it up:

  • Master alive and well (no threads in error state!),
  • every execution daemon alive and well,
  • count of jobs in error state doesn't exceed 5 % of all jobs running,
  • count of jobs pending doesn't exceed 5 % of all jobs running.

Version: unspecified
Severity: enhancement

Details

Reference
bz48668

Related Objects

Event Timeline

• bzimport raised the priority of this task from to High.Nov 22 2014, 1:20 AM
• bzimport added a project: Toolforge.
• bzimport set Reference to bz48668.
scfc created this task.May 21 2013, 4:16 AM
• bzimport added a comment.Sep 28 2013, 12:18 AM

sumanah wrote:

As with bug 51434 , I think this would be a very good step for improving the reliability of the services we provide -- and getting stats to show it. :-)

coren moved this task from Triage to Backlog on the Toolforge board.Nov 25 2014, 4:18 PM
coren closed this task as a duplicate of T69881: Track gridengine stats on Graphite.
scfc mentioned this in T109732: Add monitoring for expected load issues on tool labs exec nodes.Aug 20 2015, 5:03 PM
• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 7:03 PM
Restricted Application added a project: Cloud-Services. · View Herald TranscriptJun 7 2017, 7:03 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL