Page MenuHomePhabricator

T374577: Community Updates module: Release to Growth Pilot Wikipedias
Closed, ResolvedPublic

Description

User story & summary:

Specific user story: As the Growth team Product Manager, I want to be able to test this new feature on several pilot wikis, so we can make an informed decision about making improvements, scaling to other wikis, or removing the feature.

Broader user story: As a new editor visiting my Newcomer homepage, I want to see community updates relevant to new editors, so that I can deepen my involvement in the wikis.

Project details:

This task includes adding scaling the new configurable "Community Updates" module for the Newcomer homepage to Growth's pilot wikis.

Acceptance Criteria:
  • Release the Community Updates module to Growth Pilot Wikis (Arabic & Spanish Wikipedia) and French & Czech Wikipedia
NOTE: the Community Updates module configuration form should be "Turned off" upon release, so the only user facing changes initially visible will be the new item on the Community Configuration dashboard (Special:CommunityConfiguration) and the empty form will be visible via Special:CommunityConfiguration/CommunityUpdates.

Event Timeline

KStoller-WMF moved this task from Backlog to Up Next (estimated tasks) on the Growth-Team board.

afaiu the only thing that blocks us from moving forward from this task is to provide a way to assign experiment variants to existing accounts with the current GrowthExperiments experiment manager. Per @Urbanecm_WMF's feedback, this should be fairly simple to achieve using wgConditionalUserOptions in the experiment target wikis.

KStoller-WMF raised the priority of this task from Medium to High.Oct 1 2024, 4:11 PM

Marking this as blocked until experiment set up is complete (task to be created by Sgs).

Marking this as blocked until experiment set up is complete (task to be created by Sgs).

T377233: Show Community updates module based on experiment variant

Change #1081099 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[operations/mediawiki-config@master] GrowthExperiments: enable community updates module in pilot wikis

https://gerrit.wikimedia.org/r/1081099

Change #1081104 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[operations/mediawiki-config@master] GrowthExperiments: enable community updates module in pilot wikis

https://gerrit.wikimedia.org/r/1081104

@nettrom_WMF, in our last meeting you mentioned you would define treatment and control group more precisely in terms of account ages. For now, we're not restricting any account by its age, all accounts including newly created are distributed 50/50 into control and the treatment group community-updates-module. Is this ok the rollout on Wed, October 30 to Spanish Wikipedia, French Wikipedia, and Egyptian Arabic?

@nettrom_WMF, in our last meeting you mentioned you would define treatment and control group more precisely in terms of account ages. For now, we're not restricting any account by its age, all accounts including newly created are distributed 50/50 into control and the treatment group community-updates-module. Is this ok the rollout on Wed, October 30 to Spanish Wikipedia, French Wikipedia, and Egyptian Arabic?

Yes, I said I was going to do that but didn't get around to it, so I very much appreciate the ping on this!

Having thought about this, if we are able to restrict this by account age I would like us to limit group assignment to accounts created after we removed the control groups on Spanish and Arabic Wikipedia. According to T320876#8361765 that would be 2022-11-02. Any account older than that can be kept out of the experiment.

I'm also fine with us skipping this and randomly assigning control and treatment groups to all accounts if you're fine with that.

Change #1081104 merged by jenkins-bot:

[operations/mediawiki-config@master] GrowthExperiments: enable community updates module in pilot wikis

https://gerrit.wikimedia.org/r/1081104

Mentioned in SAL (#wikimedia-operations) [2024-10-30T21:07:25Z] <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1081104|GrowthExperiments: enable community updates module in pilot wikis (T374664)]]

Mentioned in SAL (#wikimedia-operations) [2024-10-30T21:09:43Z] <tgr@deploy2002> tgr, sgimeno: Backport for [[gerrit:1081104|GrowthExperiments: enable community updates module in pilot wikis (T374664)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-10-30T21:17:35Z] <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1081104|GrowthExperiments: enable community updates module in pilot wikis (T374664)]] (duration: 10m 10s)

Mentioned in SAL (#wikimedia-operations) [2024-10-31T14:11:25Z] <sergi0> eswiki, arwiki, cswiki, frwiki running mwscript userOptions.php --wiki=frwiki --delete-defaults growthexperiments-homepage-variant (T374664)

Etonkovidova subscribed.

Per @KStoller-WMF's request, I enabled the campaigns via Community Updates at frwiki, cswiki, eswiki:

arwiki would be handled by @Dyolf77_WMF.

Checked the wikis mentioned above - Community Updates are enabled (and the form is filled out) for the pilot wikis) - arwiki, eswiki, cswiki, and frwiki. A new account on eswiki (Community Updates will be displayed to new users with zero edits) will see the Community Updates module on Special:Homepage

Screen Shot 2024-11-20 at 2.21.10 PM.png (1×1 px, 286 KB)