Page MenuHomePhabricator

Deploy Summaries pilot to 20% of anonymous mobile users for 5341 articles
Closed, DeclinedPublic2 Estimated Story Points

Description

Background

  • We are now ready to launch the summaries pilot on the mobile website

User story

  • As a reader, I want the ability to opt into the summaries pilot so that I can use summaries
  • As a product team, we want the ability to display summaries to a small group of readers on mobile so that we can build a better feature

Before deployment

Requirements

  • Deploy summaries pilot on the Minerva skin of English Wikipedia.
  • Generate events that allow @jwang to confirm that instrumentation looks good before continuing.

Deploy timeline

BDD

  • For QA engineer to fill out

Test Steps

  • For QA engineer to fill out

Design

  • Add mockups and design requirements

Acceptance criteria

Communication criteria - does this need an announcement or discussion?

  • Ensure experiment has been announced in technews

Rollback plan

Once a summary is rendered it will be in cached HTML. Summaries are hidden by default so it should be safe to revert the deploy provided we can confirm the CSS that hides them will continue to load.

This task was created by Version 1.2.0 of the Web team task template using phabulous

Wikis: English Wikipedia
Sample size: 10% receive banner
Date:
Blockers:

  • Set up central notice campaign

Possible options for generating events

  1. Turn on central notice campaign so readers can opt in for 1% of readers on English Wikipedia.
  2. Use team to generate lots of events

Event Timeline

Jdlrobson-WMF changed the task status from Open to In Progress.
Jdlrobson-WMF triaged this task as High priority.
Jdlrobson-WMF moved this task from Incoming to Q4 on the Web-Team board.

@Jdrewniak we are kicking off sprint Wednesday! Please prioritize filling this card out and starting a refinement thread as otherwise this won't happen!

ovasileva updated the task description. (Show Details)
Jdlrobson-WMF renamed this task from [placeholder] Deploy Summaries pilot to Deploy Summaries pilot.May 19 2025, 6:30 PM
Jdrewniak set the point value for this task to 3.May 20 2025, 1:52 PM
Jdrewniak changed the point value for this task from 3 to 2.May 20 2025, 1:57 PM

Once a summary is rendered it will be in cached HTML.

In terms of a rollback strategy that would invalidate the cache, since the extension will only affect the 8,000 selected articles with summaries, we could run a script that:

  • Reads all the files in the /summaries directory in the extension
  • extracts the article titles based on the filename
  • Incrementally purges all of the titles with summaries.

I don't know what the API limits are for purging pages, but we can throttle the purge action in a script like that if necessary.

Jdlrobson-WMF changed the task status from In Progress to Open.May 20 2025, 6:21 PM
Jdlrobson-WMF moved this task from Q4 to Sprint Backlog on the Web-Team board.
ovasileva updated the task description. (Show Details)
ovasileva added subscribers: sgrabarczuk, Mh-3110.

From steering discussion (@Jdrewniak, @Jdlrobson):

  1. We will deploy the summaries without the campaign for testing
  2. We will then do T395123: Data QA: Summaries instrumentation
  3. We will do the banner setup T387771: [summaries] Set up CentralNotice campaign for mobile summaries pilot
  4. Announce experiment on-wiki and in tech news
  5. Turn on the banner for 1%
  6. Turn on the banner for 10%
  7. Create ticket to turn off banners
  8. Turn off banners
  9. Turn off pilot and disable extension

Refined requirements based on above.

Change #1151280 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[operations/mediawiki-config@master] Deploy summaries pilot

https://gerrit.wikimedia.org/r/1151280

Change #1151280 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy summaries pilot

https://gerrit.wikimedia.org/r/1151280

Mentioned in SAL (#wikimedia-operations) [2025-05-27T21:03:50Z] <toyofuku@deploy1003> Started scap sync-world: Backport for [[gerrit:1151280|Deploy summaries pilot (T393940)]], [[gerrit:1151290|Deploy Vector empty search recommendations to wikivoyage and group 1 wikipedias (T393943)]]

Mentioned in SAL (#wikimedia-operations) [2025-05-27T21:05:53Z] <toyofuku@deploy1003> toyofuku, ksarabia, bwang: Backport for [[gerrit:1151280|Deploy summaries pilot (T393940)]], [[gerrit:1151290|Deploy Vector empty search recommendations to wikivoyage and group 1 wikipedias (T393943)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Change #1151385 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[operations/mediawiki-config@master] Deploy summaries to text wiki

https://gerrit.wikimedia.org/r/1151385

Change #1151791 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] Zuul: [mediawiki/extensions/ArticleSummaries] Promote to Wikimedia production

https://gerrit.wikimedia.org/r/1151791

Change #1151791 merged by jenkins-bot:

[integration/config@master] Zuul: [mediawiki/extensions/ArticleSummaries] Promote to Wikimedia production

https://gerrit.wikimedia.org/r/1151791

Mentioned in SAL (#wikimedia-releng) [2025-05-28T20:27:47Z] <James_F> Zuul: [mediawiki/extensions/ArticleSummaries] Promote to Wikimedia production, for T393940

SToyofuku-WMF subscribed.

Not sure which column to put it in, so leaving it here for now

Branching change is merged, as is the update to Zuul. Jon is now working on the sequencing of remaining work (lmk if I can help in any way!)

Jdlrobson-WMF changed the task status from Open to Stalled.May 28 2025, 9:53 PM
Jdlrobson-WMF reassigned this task from Jdlrobson-WMF to ovasileva.
  • We (read I) missed a step in deploying to production that we need to branch the extension. That was done today.
  • The mistake means the earliest we can deploy to production (test.wikipedia.org) or en.wikipedia.org is Monday 9th June 2025.

This means this ticket will need to carry over to next sprint.

ovasileva updated the task description. (Show Details)
ovasileva updated the task description. (Show Details)
Jdlrobson-WMF renamed this task from Deploy Summaries pilot to Deploy Summaries pilot to 20% of anonymous mobile users for 5341 articles.Jun 4 2025, 5:15 PM
Jdrewniak removed ovasileva as the assignee of this task.

Change #1151385 abandoned by Stoyofuku-wmf:

[operations/mediawiki-config@master] Deploy summaries to text wiki

Reason:

Gonna archive this if that's okay as we're indefinitely paused on summaries work - pls unarchive if you'd prefer!!

https://gerrit.wikimedia.org/r/1151385