Page MenuHomePhabricator

Difference between Linux/Windows version
Closed, ResolvedPublic

Description

Track the difference we find between Linux and Windows version.

  • TTFB is to high for Firefox T186464
  • Chrome on Linux seems much faster than on Windows for Desktop tests:

Screen Shot 2018-02-04 at 7.43.32 PM.png (512×1 px, 87 KB)

Screen Shot 2018-02-04 at 7.43.21 PM.png (922×1 px, 134 KB)

  • Chrome on Windows is called Google Chrome but only Chrome on Linux (we need to manually change all dashboards).
  • The Linux Chrome will give us more time to interactive metrics!

Screen Shot 2018-02-04 at 7.49.23 PM.png (518×2 px, 125 KB)

  • Firefox misses number of requests and request by type T186476
  • Firefox misses User Timings T186477

Event Timeline

Peter triaged this task as Medium priority.Feb 4 2018, 6:50 PM
Peter created this task.

We still have tests that times out, check the log for this run: https://integration.wikimedia.org/ci/job/performance-webpagetest-linux-wmf/117/console

This gap (24 min) doesn't seem right:

12:04:57 Tested URL https://en.wikipedia.org/wiki/Facebook for us-east-1-hosted-linux:Chrome with connectivity Cable result: http://wpt.wmftest.org/results.php?test=180208_NS_KX&medianRun=median&medianMetric=SpeedIndex
12:04:57 Tested using Chrome 64.0.3282.140 on unknown
12:04:57 Succesfully sent metrics.
12:04:57 Succesfully sent metrics.
12:04:57 Succesfully sent metrics.
12:04:57 Succesfully sent metrics.
12:04:57 Succesfully sent metrics.
12:28:02 Tested URL https://wikidata.beta.wmflabs.org/wiki/Q15905 for us-east-1-hosted-linux:Firefox with connectivity Cable result: http://wpt.wmftest.org/results.php?test=180208_0X_KY&medianRun=fastest&medianMetric=SpeedIndex
12:28:02 Missing user timing metrics for view firstView

The Linux version is gives us more stable metrics with the change in connectivity: https://github.com/WPO-Foundation/wptagent/commit/f90afeef410cf522b7bafde8ea906901a150004f

We also turned off the auto-scaling on Linux, it doesn't work and now the agent run just fine.

Only thing left is missing metrics but that's because of statsv and is worked on in T186476