As part of the survey, it would be interesting in order to reduce noise in the data to be able to oversample specific articles, where NavTiming + survey would be recorded more often than others.
Description
Description
Details
Details
Customize query in gerrit
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Gilles | T165272 Review research on performance perception | |||
| Declined | • Gilles | T184510 Ideas for performance perception studies | |||
| Resolved | • Gilles | T187299 User-perceived page load performance study | |||
| Resolved | • Gilles | T197607 Add ability to oversample specific pages |
Event Timeline
Comment Actions
Change 457900 had a related patch set uploaded (by Gilles; owner: Gilles):
[mediawiki/extensions/NavigationTiming@master] Add ability to oversample specific pages
Comment Actions
Change 457900 merged by jenkins-bot:
[mediawiki/extensions/NavigationTiming@master] Add ability to oversample specific pages
Comment Actions
Change 472433 had a related patch set uploaded (by Gilles; owner: Gilles):
[mediawiki/extensions/NavigationTiming@master] Only ever inject the performance survey once
Comment Actions
Change 472433 merged by jenkins-bot:
[mediawiki/extensions/NavigationTiming@master] Only ever inject the performance survey once
Comment Actions
Change 478656 had a related patch set uploaded (by Gilles; owner: Gilles):
[operations/mediawiki-config@master] Oversample performance survey on specific ruwiki articles
Comment Actions
Change 478656 merged by jenkins-bot:
[operations/mediawiki-config@master] Oversample performance survey on specific ruwiki articles
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2018-12-10T12:56:34Z] <gilles@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T187299 T197607 Oversample performance survey on specific ruwiki articles (duration: 00m 46s)
Comment Actions
I'm not sure that it worked or that the 5 articles picked made a big difference, there's no visible uptake in ruwiki survey responses:
Comment Actions
NavigationTiming doesn't store article id, but it stores the revision id. For a popular article like https://ru.wikipedia.org/wiki/Россия which is part of the oversampled articles, it gives a recognisable revision id. Last edit was on the 8th, with revision id 96715436. Let's look at how often navtiming was recorded for it on the 9th and on the 10th once per-page oversampling was enabled (mid-day):
| Date | ruwiki navtiming with revId = 96715436 |
| Dec 9 | 5 |
| Dec 10 | 37 |
Which means that the oversampling is working, but the distribution of traffic has such a long tail that boosting these top articles 10x hardly makes a dent in the total sampling numbers.
If we want to speed up data collection for the survey we need to either increase the navtiming oversampling altogether for ruwiki or consider asking another large wiki's community about running the survey.