Page MenuHomePhabricator

Investigate increase in First Visual Change mobile enwiki
Closed, ResolvedPublic

Assigned To
Authored By
Peter
Jun 10 2019, 8:10 AM
Referenced Files
F29639717: Capture d'écran 2019-06-25 10.56.46.png
Jun 25 2019, 9:03 AM
F29639720: Capture d'écran 2019-06-25 10.57.24.png
Jun 25 2019, 9:03 AM
F29509873: Screen Shot 2019-06-13 at 3.14.47 PM.png
Jun 13 2019, 1:18 PM
F29509941: Screen Shot 2019-06-13 at 3.18.07 PM.png
Jun 13 2019, 1:18 PM
F29416058: Screen Shot 2019-06-10 at 10.07.59 AM.png
Jun 10 2019, 8:10 AM
F29416059: Screen Shot 2019-06-10 at 10.07.49 AM.png
Jun 10 2019, 8:10 AM
F29416060: Screen Shot 2019-06-10 at 10.08.09 AM.png
Jun 10 2019, 8:10 AM
F29416068: Screen Shot 2019-06-10 at 10.08.43 AM.png
Jun 10 2019, 8:10 AM
Subscribers

Description

We had an alert on enwiki for First Visual Change on mobil. Checking WebPageTest the increase is there:

Screen Shot 2019-06-10 at 10.07.59 AM.png (1×2 px, 332 KB)

Screen Shot 2019-06-10 at 10.07.49 AM.png (1×2 px, 302 KB)

Screen Shot 2019-06-10 at 10.08.09 AM.png (1×2 px, 364 KB)

And no change on TTFB (at least it doesn't look like it):

Screen Shot 2019-06-10 at 10.08.43 AM.png (1×2 px, 330 KB)

Screen Shot 2019-06-10 at 10.09.44 AM.png (1×2 px, 341 KB)

Need to check when new Chrome was rolled out and if I can see something in WebPageReplay (we haven't updated Chrome there yet).

Event Timeline

No change in WebPageReplay and I could see that it happened in the same time of Chrome 75 for WebPageTest. On Wednesday I'll roll out 75 for WebPageReplay and I can create an upstream task if we get it there too.

I've pushed Chrome 75 now, let it run for the day and have another look.

Yep got a small change on Browsertime/WebPageReplay too (one tick):

Screen Shot 2019-06-13 at 3.14.47 PM.png (966×1 px, 187 KB)

However Chrome 75 gives more stable values than before on enwiki:

Screen Shot 2019-06-13 at 3.18.07 PM.png (980×972 px, 236 KB)

Let us see when 75 rolls out for real users.

Looking at June 16 - now. Shape of the ramp-up during that period:

Capture d'écran 2019-06-25 10.56.46.png (435×1 px, 92 KB)

Capture d'écran 2019-06-25 10.57.24.png (431×1 px, 91 KB)

loadEventEnd:

browser_familybrowser_majormedianp90p95count
Chrome Mobile741277.03703.05851.01274072
Chrome Mobile751166.03259.04911.01345331
Chrome741422.04649.07221.01148045
Chrome751388.04527.06951.01011191

firstPaint:

browser_familybrowser_majormedianp90p95count
Chrome Mobile74883234734331272779
Chrome Mobile75800206029681344102
Chrome741117351452511145951
Chrome751071339349831009683

Chrome 75 looks like a significant performance improvement in RUM across the board!

8.7% faster median loadEventEnd on mobile and 2.4% faster on desktop.
9.4% faster median firstPaint on mobile and 4.2% faster on desktop.

Hive queries used: P8651