Page MenuHomePhabricator

Collect and graph stdev for all timing metrics
Closed, ResolvedPublic

Description

With the new setup we should make sure we get stdev for both WebPageTest and Browsertime so we easier can keep track of how stable metrics we have. Having a base makes it easier for us when we want to move to something else.

I've added a test dashboard for our WebPageReplay runs and its super useful, we can see that we have had spikes:

Screen Shot 2019-09-24 at 4.40.42 PM.png (2,324×938 px, 208 KB)

Today we don't collect the metrics from WebPageTest, so let us start with that first and then create a WebPageTest dashboard.

Event Timeline

Change 539089 had a related patch set uploaded (by Phedenskog; owner: Phedenskog):
[performance/synthetic-monitoring-tests@master] Update container that send standard deviation by defaut for WPT.

https://gerrit.wikimedia.org/r/539089

Change 539089 merged by jenkins-bot:
[performance/synthetic-monitoring-tests@master] Update container that send standard deviation by defaut for WPT.

https://gerrit.wikimedia.org/r/539089

It's there now for both Browsertime and WebPageTest

Screen Shot 2019-09-25 at 2.22.11 PM.png (1,146×906 px, 87 KB)