I've started to setup alerts for the new setup. We have one alerts setup for enwiki and I want you @Gilles @Krinkle @aaron to check it first before I start to add more wikis:
https://grafana.wikimedia.org/d/2kP3FjAZk/webpagereplay-enwiki-alerts
At the moment we use a large moving average window (6h) but when I deploy to more servers we can make that smaller.
I'm thinking like this: we have one alert dashboard page per wiki. In this example we have alerts for Firefox and Chrome on Desktop and emulated mobile for Chrome. This means I will create one page per wiki.
To jump to drill down (more info per URL), each dashboard could have a link like this:
Or is it a better way to do it? When you jump to drill down you can use the annotations to see screenshot etc.