Page MenuHomePhabricator
Create Task
Maniphest T219601

Create checks that alerts on cirrussearch update lags
Closed, ResolvedPublic
Actions

Description

Following ES6 upgrade, We need an icinga check that alerts when there's update lag.
here: https://grafana.wikimedia.org/d/JLK3I_siz/elasticsearch-indexing?panelId=44&fullscreen&orgId=1 seems a good place to start

Details

SubjectRepoBranchLines +/-
icinga: add mediawiki cirrus update lag checkoperations/puppetproduction+10 -0
Customize query in gerrit

Event Timeline

• Mathew.onipe created this task.Mar 29 2019, 9:51 AM
Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Current work). · View Herald TranscriptMar 29 2019, 9:51 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Gehel added a project: Wikimedia-Incident.Mar 29 2019, 3:23 PM
gerritbot added a comment.Apr 1 2019, 11:34 AM

Change 500422 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe):
[operations/puppet@production] icinga: add mediawiki cirrus update lag check

https://gerrit.wikimedia.org/r/500422

gerritbot added a project: Patch-For-Review.Apr 1 2019, 11:34 AM
greg moved this task from Active investigation to Follow-up prevention on the Wikimedia-Incident board.Apr 2 2019, 6:24 PM
EBernhardson triaged this task as Medium priority.Apr 4 2019, 5:17 PM
EBernhardson moved this task from needs triage to Current work on the Discovery-Search board.
EBernhardson edited projects, added Discovery-Search (Current work); removed Discovery-Search.
gerritbot added a comment.Apr 5 2019, 9:42 AM

Change 500422 merged by Gehel:
[operations/puppet@production] icinga: add mediawiki cirrus update lag check

https://gerrit.wikimedia.org/r/500422

• Mathew.onipe moved this task from Incoming to Needs Reporting on the Discovery-Search (Current work) board.Apr 6 2019, 12:49 PM
debt closed this task as Resolved.Apr 15 2019, 6:01 PM
debt claimed this task.
Krinkle edited projects, added Sustainability (Incident Followup); removed Wikimedia-Incident.Apr 28 2020, 9:50 PM
Maintenance_bot removed a project: Patch-For-Review.Apr 28 2020, 10:16 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL