Page MenuHomePhabricator
Create Task
Maniphest T90642

Replace uses of monitoring::ganglia with monitoring::graphite_* [5 pts]
Closed, ResolvedPublic
Actions

Description

We want to deprecate check_ganglia in favor of check_graphite. Both Hadoop and Kafka still have monitoring::ganglia uses.

Details

SubjectRepoBranchLines +/-
Remove no longer used monitoring::ganglia 'hadoop-hdfs-namenode-primary-is-active'operations/puppetproduction+0 -10
Remove monitoring::ganglia hadoop-hdfs-namenode-primary-is-activeoperations/puppetproduction+2 -1
Allow nagios user to sudo to hdfs to run check_hdfs_active_namenodeoperations/puppetproduction+10 -2
Update cdh module with check_hdfs_active_namenode script, set up nrpe monitoringoperations/puppetproduction+9 -1
Add script for icinga checks of hdfs active namenodeoperations/puppet/cdhmaster+60 -0
Configure hadoop master and worker to send jmx stats to statsdoperations/puppetproduction+8 -2
Add statsd param to hadoop jmxtrans classesoperations/puppet/cdhmaster+24 -0
Customize query in gerrit

Related Objects

Event Timeline

Ottomata created this task.Feb 24 2015, 9:53 PM
Ottomata claimed this task.
Ottomata raised the priority of this task from to Low.
Ottomata updated the task description. (Show Details)
Ottomata added a project: Analytics-Clusters.
Ottomata subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 24 2015, 9:53 PM
Ottomata added a project: acl*sre-team.Feb 24 2015, 9:53 PM
Ottomata set Security to None.
Krenair added a project: observability.May 30 2015, 6:41 PM
Krenair subscribed.
• kevinator added a project: Analytics-Kanban.Jun 29 2015, 8:13 PM
Restricted Application added a subscriber: Matanya. · View Herald TranscriptJun 29 2015, 8:13 PM
• kevinator moved this task from Next Up to Paused on the Analytics-Kanban board.Jun 29 2015, 8:13 PM
Ottomata added a comment.Aug 25 2015, 3:39 PM

We removed a bunch of monitoring::ganglia usages as part of the Kafka upgrade and expansion. The only one that is currently left for analytics use is monitoring::ganglia { 'hadoop-hdfs-namenode-primary-is-active':

gerritbot subscribed.Oct 7 2015, 7:17 PM

Change 244248 had a related patch set uploaded (by Ottomata):
Add statsd param to hadoop jmxtrans classes

https://gerrit.wikimedia.org/r/244248

gerritbot added a project: Patch-For-Review.Oct 7 2015, 7:17 PM
gerritbot added a comment.Oct 7 2015, 7:20 PM

Change 244248 merged by Ottomata:
Add statsd param to hadoop jmxtrans classes

https://gerrit.wikimedia.org/r/244248

Ottomata mentioned this in rOPCD160899e65c19: Add statsd param to hadoop jmxtrans classes.Oct 7 2015, 7:21 PM
gerritbot added a comment.Oct 7 2015, 7:21 PM

Change 244249 had a related patch set uploaded (by Ottomata):
Configure hadoop master and worker to send jmx stats to statsd

https://gerrit.wikimedia.org/r/244249

Ottomata moved this task from Paused to In Progress on the Analytics-Kanban board.Oct 7 2015, 7:22 PM
gerritbot added a comment.Oct 7 2015, 7:24 PM

Change 244249 merged by Ottomata:
Configure hadoop master and worker to send jmx stats to statsd

https://gerrit.wikimedia.org/r/244249

Ottomata mentioned this in rOPUPb3bb5614ff0c: Configure hadoop master and worker to send jmx stats to statsd.Oct 7 2015, 7:25 PM
gerritbot added a comment.Oct 8 2015, 4:05 PM

Change 244456 had a related patch set uploaded (by Ottomata):
Add script for icinga checks of hdfs active namenode

https://gerrit.wikimedia.org/r/244456

gerritbot added a comment.Oct 8 2015, 4:11 PM

Change 244456 merged by Ottomata:
Add script for icinga checks of hdfs active namenode

https://gerrit.wikimedia.org/r/244456

Dzahn subscribed.Oct 8 2015, 4:11 PM

This is really just curiosity and not a rhetorical question. What is better about monitoring::graphite vs. monitoring:;ganglia?

gerritbot added a comment.Oct 8 2015, 4:12 PM

Change 244457 had a related patch set uploaded (by Ottomata):
Update cdh module with check_hdfs_active_namenode script, set up nrpe monitoring

https://gerrit.wikimedia.org/r/244457

gerritbot added a comment.Oct 8 2015, 4:14 PM

Change 244457 merged by Ottomata:
Update cdh module with check_hdfs_active_namenode script, set up nrpe monitoring

https://gerrit.wikimedia.org/r/244457

gerritbot added a comment.Oct 8 2015, 4:40 PM

Change 244460 had a related patch set uploaded (by Ottomata):
Allow nagios user to sudo to hdfs to run check_hdfs_active_namenode

https://gerrit.wikimedia.org/r/244460

gerritbot added a comment.Oct 8 2015, 4:43 PM

Change 244460 merged by Ottomata:
Allow nagios user to sudo to hdfs to run check_hdfs_active_namenode

https://gerrit.wikimedia.org/r/244460

gerritbot added a comment.Oct 8 2015, 6:22 PM

Change 244482 had a related patch set uploaded (by Ottomata):
Remove monitoring::ganglia hadoop-hdfs-namenode-primary-is-active

https://gerrit.wikimedia.org/r/244482

gerritbot added a comment.Oct 8 2015, 6:25 PM

Change 244482 merged by Ottomata:
Remove monitoring::ganglia hadoop-hdfs-namenode-primary-is-active

https://gerrit.wikimedia.org/r/244482

Ottomata renamed this task from Replace uses of monitoring::ganglia with monitoring::graphite_* to Replace uses of monitoring::ganglia with monitoring::graphite_* [8 pts].Oct 8 2015, 6:29 PM
gerritbot added a comment.Oct 8 2015, 6:45 PM

Change 244491 had a related patch set uploaded (by Ottomata):
Remove no longer used monitoring::ganglia 'hadoop-hdfs-namenode-primary-is-active'

https://gerrit.wikimedia.org/r/244491

gerritbot added a comment.Oct 8 2015, 6:46 PM

Change 244491 merged by Ottomata:
Remove no longer used monitoring::ganglia 'hadoop-hdfs-namenode-primary-is-active'

https://gerrit.wikimedia.org/r/244491

Ottomata moved this task from In Progress to Done on the Analytics-Kanban board.Oct 8 2015, 6:48 PM
Ottomata renamed this task from Replace uses of monitoring::ganglia with monitoring::graphite_* [8 pts] to Replace uses of monitoring::ganglia with monitoring::graphite_* [5 pts].Oct 9 2015, 3:41 PM
• kevinator closed this task as Resolved.Oct 9 2015, 4:21 PM
• kevinator subscribed.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL