Positive reinforcement: Deploy the new Impact module to all Wikipedias
Open, LowPublic
Actions

Description

User story & summary:

As a newcomer, I want to understand the impact of my edits, so that I receive some automated feedback and encouragement to continue editing.

As the Growth team, I want to ensure we communicate about the new Impact module so that communities are informed and the release goes smoothly.

Background & research:

The revised impact module provides new editors with more context about their impact. The new design includes far more personalized info and data visualizations than the previous design.

Acceptance Criteria:

break rollout into two groups (we might not want to scale to all wikis at once to avoid performance issues, but we should be able to scale fairly quickly)
- Test group: released with the A/B test configuration that we have on the pilot wikis (50% get the new impact module, 50% get the old impact module)
  - Greek Wikipedia (el)
  - Persian Wikipedia (fa)
  - French Wikipedia (fr)
  - French Wiktionary (frwikt)
  - Indonesian Wikipedia (id)
  - Polish Wikipedia (pl)
  - Portuguese Wikipedia (pt)
  - Romanian Wikipedia (ro)
  - Turkish Wokipedia (tr)
  - Vietnamese Wikipedia (vi)
- all remaining wikis:
- Inform communities
work with Product and Engineering to determine a rollout schedule
communicate rollout as needed

Details

	Project	Branch	Lines +/-	Subject
	operations/mediawiki-config	master	+99 -0	[Growth] Enable new Impact for 10 additional wikis
	operations/mediawiki-config	master	+9 -0	[Growth] Enable user impact refresh on 10 more wikis

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	KStoller-WMF	T248330 [EPIC] Growth: Positive reinforcement
Open	None	T222310 [EPIC] Positive reinforcement: New Impact Module
Open	Urbanecm_WMF	T336203 Positive reinforcement: Deploy the new Impact module to all Wikipedias

Event Timeline

KStoller-WMF created this task.Mon, May 8, 8:11 PM

KStoller-WMF triaged this task as Low priority.Mon, May 8, 8:14 PM

KStoller-WMF moved this task from Incoming to Ready for Development on the Growth-Team (Current Sprint) board.

Which performance issues could happen?

Trizek-WMF added a project: User-notice.Tue, May 9, 6:21 PM

Trizek-WMF moved this task from To Triage to Not ready to announce on the User-notice board.

In T336203#8837533, @Trizek-WMF wrote:

Which performance issues could happen?

@kostajh, what is your concern there?

Should we test with a group of 10-20 wikis first to check if things are going okay, and then release to everyone?

In T336203#8838212, @Trizek-WMF wrote:

In T336203#8837533, @Trizek-WMF wrote:

Which performance issues could happen?

@kostajh, what is your concern there?

Should we test with a group of 10-20 wikis first to check if things are going okay, and then release to everyone?

I'd like to make sure our maintenance script for refreshing user impact data will handle the X% increase in users it has to process, and we also need to make sure that the database table storage size stays reasonable.

I suspect those things will be fine, but we'd want to make sure we handle 10-20 wikis first before switching it on for all wikis.

Trizek-WMF updated the task description. (Show Details)Wed, May 10, 1:47 PM

Restricted Application added subscribers: Huji, Strainu. · View Herald TranscriptWed, May 10, 1:47 PM

@kostajh, I added a list of 10 wikis to the task description, as a first group. Let me know it it is enough.
I picked these ones, as they are listed as special cases on our deployment table. It will ease that deployment table's update.

Let's enable wgGERefreshUserImpactDataMaintenanceScriptEnabled for those wikis, and then ~48 hours later we can enable wgGEUseNewImpactModule. I suggest we do both of those things next week, maybe on May 22/24 or May 23/25.

Deal.

Johan moved this task from In current Tech/News draft to Already announced/Archive on the User-notice board.Fri, May 19, 3:49 PM

Johan moved this task from Already announced/Archive to In current Tech/News draft on the User-notice board.

We are good to deploy, the communities have bene informed.

Trizek-WMF removed Trizek-WMF as the assignee of this task.Mon, May 22, 6:27 PM

Quiddity moved this task from In current Tech/News draft to Already announced/Archive on the User-notice board.Thu, May 25, 7:11 PM

KStoller-WMF moved this task from Ready for Development to Top Product Priorities on the Growth-Team (Current Sprint) board.Fri, May 26, 9:25 PM

Change 924053 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[operations/mediawiki-config@master] [Growth] Enable user impact refresh on 10 more wikis

https://gerrit.wikimedia.org/r/924053

gerritbot added a project: Patch-For-Review.Mon, May 29, 9:08 AM

Change 924060 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[operations/mediawiki-config@master] [Growth] Enable new Impact for 10 additional wikis

https://gerrit.wikimedia.org/r/924060

Change 924053 merged by jenkins-bot:

[operations/mediawiki-config@master] [Growth] Enable user impact refresh on 10 more wikis

https://gerrit.wikimedia.org/r/924053

Mentioned in SAL (#wikimedia-operations) [2023-05-30T16:07:26Z] <urbanecm@deploy1002> Started scap: Backport for [[gerrit:924053|[Growth] Enable user impact refresh on 10 more wikis (T336203)]]

Mentioned in SAL (#wikimedia-operations) [2023-05-30T16:14:34Z] <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:924053|[Growth] Enable user impact refresh on 10 more wikis (T336203)]] (duration: 07m 08s)

Will this be deployed to the test group (the first 10 wikis) in the same A/B test configuration that we have on the pilot wikis (50% get the new, 50% get the old), or will everyone get the new Impact module? It'll be a lot easier to measure the impact if it's an A/B test, but I'm not sure if that'll happen automagically or if it requires a lot of extra work?

Will this be deployed to the test group (the first 10 wikis) in the same A/B test configuration that we have on the pilot wikis (50% get the new, 50% get the old)

That was my hope, but I now realize I didn't specify that in the task description.
@Urbanecm_WMF Did you read my mind, or is a further change needed? (Sorry!)

KStoller-WMF updated the task description. (Show Details)Tue, May 30, 5:30 PM

I enabled the user impact data refresh script on the ten target wikis requested. I also asked for a manual run of mediawiki_job_growthexperiments-userImpactUpdateRecentlyEdited and mediawiki_job_growthexperiments-userImpactUpdateRecentlyRegistered, both jobs finished quickly and the growthexperiments_user_impact table is now non-empty on all the target wikis.

FTR, this doesn't actually make the module accessible to users yet (that can come within a day or two).

In T336203#8889675, @KStoller-WMF wrote:

Will this be deployed to the test group (the first 10 wikis) in the same A/B test configuration that we have on the pilot wikis (50% get the new, 50% get the old)

That was my hope, but I now realize I didn't specify that in the task description.
@Urbanecm_WMF Did you read my mind, or is a further change needed? (Sorry!)

I didn't realize that was a part of the requirements before @nettrom_WMF asked the question, but after it was asked, I understood that indeed was something we want to do. Thanks @nettrom_WMF for the question and @KStoller-WMF for confirming!

Urbanecm_WMF claimed this task.Tue, May 30, 5:57 PM

Change 924060 merged by jenkins-bot:

[operations/mediawiki-config@master] [Growth] Enable new Impact for 10 additional wikis

https://gerrit.wikimedia.org/r/924060

Maintenance_bot removed a project: Patch-For-Review.Wed, May 31, 1:10 PM

Mentioned in SAL (#wikimedia-operations) [2023-05-31T13:20:03Z] <urbanecm@deploy1002> Started scap: Backport for [[gerrit:924060|[Growth] Enable new Impact for 10 additional wikis (T336203)]]

Mentioned in SAL (#wikimedia-operations) [2023-05-31T13:21:40Z] <urbanecm@deploy1002> urbanecm: Backport for [[gerrit:924060|[Growth] Enable new Impact for 10 additional wikis (T336203)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-05-31T13:28:16Z] <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:924060|[Growth] Enable new Impact for 10 additional wikis (T336203)]] (duration: 08m 13s)

The release happened few minutes ago. FYI @KStoller-WMF @Trizek-WMF @nettrom_WMF.

nettrom_WMF mentioned this in T334411: Positive Reinforcement: investigate difference in mobile activation.Mon, Jun 5, 8:11 PM

Positive reinforcement: Deploy the new Impact module to all WikipediasOpen, LowPublicActions