Page MenuHomePhabricator

Enable sidebar instrumentation on test wikis
Closed, ResolvedPublic3 Estimated Story Points

Description

Background

We'd like to enable the instrumentation for the sidebar prior to deploying the features to our test wikis to ensure the event rate is within bounds

Acceptance criteria

  • enable sidebar instrumentation on the following projects:

Part 1:

  • euwiki
  • frwiktionary
  • ptwikiversity

Part 2

  • frwiki
  • hewiki
  • fawiki

Event Timeline

ovasileva set the point value for this task to 3.Jul 15 2020, 4:08 PM

Change 614888 had a related patch set uploaded (by Jdrewniak; owner: Jdlrobson):
[operations/mediawiki-config@master] Enable instrumentation for wikis in the desktop improvements testing group (round 1)

https://gerrit.wikimedia.org/r/614888

Change 614888 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable instrumentation for wikis in the desktop improvements testing group (round 1)

https://gerrit.wikimedia.org/r/614888

This is live on the part 1 wikis. Before proceeding with enabling on part 2 wikis we should validate that the throughput matches our original estimations

French Wikipedia gets 26.1 million views an hour. French Wiktionary gets 1.3m. Based on that 1.3/26.1 that’s 5% of the traffic.
So X / 0.05 = Y
where Y = “predicted number of events per hour on fr.wikipedia” and X = “number of events per hour on fr.wiktionary”.

Per analytics and @Ottomata (T250282#6119734) “VirtualPageView does around 1000 events per second. Ideally yours would do not more than that, hopefully less, but if we need to go bigger it is possible.”

So we want to make sure (( X * 0.05) / 60 / 60 < 1000) (X = number of events per hour on fr.wiktionary) before continuing.

@Mayakp.wiki reports that we should expect around 362 init events per sec from French Wikipedia so I think we're good to continue here with the 20% sampling rate.

@Mayakp.wiki reports that we should expect around 362 init events per sec from French Wikipedia so I think we're good to continue here with the 20% sampling rate.

perfect!

Change 616125 had a related patch set uploaded (by Jdlrobson; owner: Jdlrobson):
[operations/mediawiki-config@master] Enable desktop click tracking instrumentation on (fr,he,fa)wikis

https://gerrit.wikimedia.org/r/616125

Change 616125 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable desktop click tracking instrumentation on (fr,he,fa)wikis

https://gerrit.wikimedia.org/r/616125

Mentioned in SAL (#wikimedia-operations) [2020-07-27T18:29:15Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable desktop web UI click tracking instrumentation on frwiki, hewiki, fawiki (T258058) (duration: 00m 56s)

I'm seeing about 7 events per second at the moment on this graph:
https://grafana.wikimedia.org/d/000000566/overview?panelId=23&fullscreen&orgId=1

@Mayakp.wiki let's sync once we have 2 days of data and can verify that we're seeing instrumentation data for all the wikis before signing off.

The number of events have picked up as of today. Here's the break up by day and wiki.

Screen Shot 2020-07-28 at 1.32.36 PM.png (251×272 px, 18 KB)

Screen Shot 2020-07-28 at 2.11.13 PM.png (568×522 px, 46 KB)

@Mayakp.wiki and @Edtadros are working on the post deployment instrumentation data-QA.

@Mayakp.wiki reports that we should expect around 362 init events per sec from French Wikipedia so I think we're good to continue here with the 20% sampling rate.

Based on the pageviews per hour dashboard for the 6 test wikis (fr.wikipedia, fr.wiktionary, pt.wikiversity, fa.wiki, he.wiki, eu.wiki) on Turnilo, I wanted to correct this to ~30 events per sec with 20% sampling. This is close to what we see in Eventlogging.

Resolving this. Instrumentation is enabled. Further QA can be tracked in T256075: Post Deployment Data QA - Collapsible Sidebar Instrumentation