Page MenuHomePhabricator
Create Task
Maniphest T204361

Raise alert level on disk space for old elasticsearch servers
Closed, ResolvedPublic
Actions

Description

Raise the alert level for old elasticsearch servers as we have been having unnecessary noise from icinga lately. These servers recover quickly.

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+5 -0Icinga disk space check for old elasticsearch servers
Customize query in gerrit

Event Timeline

• Mathew.onipe created this task.Sep 14 2018, 3:43 PM
Restricted Application added a project: Discovery-Search. · View Herald TranscriptSep 14 2018, 3:43 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
• Mathew.onipe edited projects, added Discovery-Search (Current work); removed Discovery-Search.Sep 14 2018, 3:49 PM
• Mathew.onipe triaged this task as Low priority.Sep 14 2018, 4:17 PM
Gehel added a project: SRE.Sep 14 2018, 5:12 PM

The current config for that check is in hiera. We want to identify the old servers and change that config just for them. The easiest way to do that is probably via regex.yaml.

Ping me to go over the details.

Gehel renamed this task from Raise alert level for old elasticsearch servers to Raise alert level on disk space for old elasticsearch servers.Sep 14 2018, 10:32 PM
gerritbot added a subscriber: gerritbot.Sep 16 2018, 6:44 PM

Change 460763 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe):
[operations/puppet@production] icinga check for old elasticsearch servers

https://gerrit.wikimedia.org/r/460763

gerritbot added a project: Patch-For-Review.Sep 16 2018, 6:44 PM
• Mathew.onipe moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.Sep 18 2018, 8:01 AM
gerritbot added a comment.Sep 18 2018, 12:46 PM

Change 460763 merged by Gehel:
[operations/puppet@production] Icinga disk space check for old elasticsearch servers

https://gerrit.wikimedia.org/r/460763

• Mathew.onipe moved this task from not in use - please delete to Needs Reporting on the Discovery-Search (Current work) board.Sep 18 2018, 1:09 PM
debt closed this task as Resolved.Oct 5 2018, 4:07 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL