Page MenuHomePhabricator

Show Community updates module based on experiment variant
Closed, ResolvedPublic1 Estimated Story Points

Description

Akin to T374632 but without using Metrics Platform as the backing bucketing system. This task is to only show the module to users in the treatment group from the "community-updates" experiment.

Acceptance criteria

  • Community updates module is only shown to users in the treatment variant "community-updates-module"

Event Timeline

Change #1080567 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/GrowthExperiments@master] SpecialHomepage: show community update module based on variant

https://gerrit.wikimedia.org/r/1080567

Change #1081099 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[operations/mediawiki-config@master] [Growth] beta: configure the A/B test experiment variants

https://gerrit.wikimedia.org/r/1081099

Change #1080567 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] SpecialHomepage: show community update module based on variant

https://gerrit.wikimedia.org/r/1080567

@Sgs - the variant "community-updates-module" will be stored in user_properties table? The new user accounts created on cswiki beta do not get Community update module displayed on their Homepage.

Change #1081099 merged by jenkins-bot:

[operations/mediawiki-config@master] [Growth] beta: configure the A/B test experiment variants

https://gerrit.wikimedia.org/r/1081099

Mentioned in SAL (#wikimedia-operations) [2024-10-30T13:19:29Z] <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1084036|Growth [test2wiki]: enable community updates module (T376952)]], [[gerrit:1081099|[Growth] beta: configure the A/B test experiment variants (T377233)]]

Mentioned in SAL (#wikimedia-operations) [2024-10-30T13:48:29Z] <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1084036|Growth [test2wiki]: enable community updates module (T376952)]], [[gerrit:1081099|[Growth] beta: configure the A/B test experiment variants (T377233)]] (duration: 29m 00s)

This is now ready to test in beta wikis. Variant distribution is 50/50 between control group and treatment group community-updates-module. The JS helper ge.utils.setUserVariant('variant-name') can be used to assign a different variant from what the system decided. Something different from prior Growth experiment setups is that the treatment group includes existing accounts, so we should test the module is shown for some "old" accounts. cc @Etonkovidova .

Checked on eswiki beta. Two new accounts: user_id=4343 - didn't get the CommunityUpdate module; another user, user_id=4344 - got the CommunityUpdate module.

Change #1085347 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/GrowthExperiments@wmf/1.43.0-wmf.28] SpecialHomepage: show community update module based on variant

https://gerrit.wikimedia.org/r/1085347

Change #1085347 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@wmf/1.43.0-wmf.28] SpecialHomepage: show community update module based on variant

https://gerrit.wikimedia.org/r/1085347

Checked on testwiki wmf.2 by creating new user accounts - one new account was presented with the Community update module, another new account did not have the module on Special:Homepage.