Maniphest T198287

Add alerts for all Browsertime/WebPageReplay wikis
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Peter
	Jun 27 2018, 9:08 AM

Description

We collect the metrics for the following wikis, and we should also add alerts for them:

dewiki
eswiki
frwiki
jawiki
nlwiki
ruwiki
svwiki
zhwiki

Details

	Subject	Repo	Branch	Lines +/-
	icinga: Add WebPageReplay alerts for ru.wiki	operations/puppet	production	+5 -0
	icinga: Add all WebPageReplay alerts.	operations/puppet	production	+61 -2

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	Peter	T197799 Add performance test for more wikis than enwiki
Resolved	Peter	T198287 Add alerts for all Browsertime/WebPageReplay wikis
Resolved	Peter	T225987 Create runbook on what to do when we get an alert

Event Timeline

Peter triaged this task as Medium priority.Jun 27 2018, 9:08 AM

Peter created this task.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 27 2018, 9:08 AM

Updated today and will add the last one tomorrow. Updated the docs: https://wikitech.wikimedia.org/wiki/Performance/WebPageReplay/Alerts

We have alerts for enwiki, beta, group 0 and group 1.

Peter updated the task description. (Show Details)Jun 29 2018, 4:18 AM

Restricted Application added a subscriber: Stang. · View Herald TranscriptJun 29 2018, 4:18 AM

I can do this after the vacation, lets think about, could there be a smarter way to do the alerts, instead of creating a dashboard for each? Templates aren't supported for alerts at the moment in Grafana.

Peter moved this task from Inbox, needs triage to To-do: Goals prioritized current Quarter on the Performance-Team board.Jun 29 2018, 4:34 AM

Peter mentioned this in T197799: Add performance test for more wikis than enwiki.

Peter added a project: Synthetic-Performance-Testing.Sep 21 2018, 7:57 AM

Shizhao added a project: Chinese-Sites.Sep 25 2018, 2:32 AM

Liuxinyu970226 subscribed.Oct 10 2018, 1:03 PM

Liuxinyu970226 added a project: Russian-Sites.Oct 13 2018, 5:10 AM

Peter moved this task from To-do: Goals prioritized current Quarter to To-do: Goals, prioritized next 4 Quarters on the Performance-Team board.Jan 15 2019, 1:03 PM

Restricted Application added a subscriber: • Gilles. · View Herald TranscriptJan 15 2019, 1:03 PM

We don't have a good way to do to add a lot of alerts (since templating doesn't work in Grafana). That means that to setup alerts for a new Wikipedia we probably should create a new dashboard so we don't overlap the current one. Let us wait for a while and see which is the best way forward.

Peter mentioned this in T219496: [Meta] Next level of synthetic testing.Mar 28 2019, 11:44 AM

These lives in a alert folder in Grafana: https://grafana.wikimedia.org/d/2kP3FjAZE/webpagereplay-ca-wikipedia-org-alerts?orgId=1

RU and AR is missing at the moment (we need more data to be collected) and then the icinga matching is missing.

Change 556108 had a related patch set uploaded (by Phedenskog; owner: Phedenskog):
[operations/puppet@production] icinga: Add all WebPageReplay alerts.

https://gerrit.wikimedia.org/r/556108

gerritbot added a project: Patch-For-Review.Dec 10 2019, 8:01 AM

Change 556108 merged by Filippo Giunchedi:
[operations/puppet@production] icinga: Add all WebPageReplay alerts.

https://gerrit.wikimedia.org/r/556108

Maintenance_bot removed a project: Patch-For-Review.Dec 10 2019, 2:11 PM

Change 558339 had a related patch set uploaded (by Phedenskog; owner: Phedenskog):
[operations/puppet@production] icinga: Add WebPageReplay alerts for ru.wiki

https://gerrit.wikimedia.org/r/558339

gerritbot added a project: Patch-For-Review.Dec 17 2019, 6:50 AM

Change 558339 merged by Filippo Giunchedi:
[operations/puppet@production] icinga: Add WebPageReplay alerts for ru.wiki

https://gerrit.wikimedia.org/r/558339

Maintenance_bot removed a project: Patch-For-Review.Dec 17 2019, 8:10 AM

Peter closed this task as Resolved.Dec 17 2019, 9:02 AM

Shizhao moved this task from Backlog to Closed on the Chinese-Sites board.Dec 17 2019, 11:59 AM

Stang unsubscribed.Nov 14 2021, 12:17 AM

Peter closed subtask T225987: Create runbook on what to do when we get an alert as Resolved.Apr 5 2022, 11:25 AM