Page MenuHomePhabricator

community-updates-module variant is assigned outside of Growth pilot wikis
Closed, ResolvedPublic

Description

Originally reported as WMF Slack post by @Michael.

According to the Growth KPI Grafana dashboard for enwiki (screenshot below), the community-updates-module variant we enabled in rOMWCae52a7b24bd2: GrowthExperiments: enable community updates module in pilot wikis (T374664) is active at English Wikipedia:

image.png (580×788 px, 88 KB)

This is not expected, the variant should be only assigned to users on pilot wikis. However, it currently does not have any user impact, as the wgGECommunityUpdatesEnabled flag is false. Since Growth experiments are single-dimensional, we need to fix this before working on T377631: Add a link (Structured task): Release to a subset of newcomers on English Wikipedia.

Acceptance Criteria
  • Outside of pilot wikis, 100% newcomers are assigned into the control variant.

Event Timeline

Change #1090830 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[operations/mediawiki-config@master] GrowthExperiments: set experiment config only in pilot wikis

https://gerrit.wikimedia.org/r/1090830

The setting is indeed applied to all wikis, my bad. I've submitted a patch to fix that, feedback appreciated as it is the first time I make use of a settings merge strategy.

The setting is indeed applied to all wikis, my bad. I've submitted a patch to fix that, feedback appreciated as it is the first time I make use of a settings merge strategy.

Commented there! Let me know if anything is unclear.

Change #1090830 merged by jenkins-bot:

[operations/mediawiki-config@master] GrowthExperiments: set experiment config only in pilot wikis

https://gerrit.wikimedia.org/r/1090830

Mentioned in SAL (#wikimedia-operations) [2024-11-14T14:37:29Z] <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1090830|GrowthExperiments: set experiment config only in pilot wikis (T379681)]]

Mentioned in SAL (#wikimedia-operations) [2024-11-14T14:41:24Z] <sgimeno@deploy2002> sgimeno: Backport for [[gerrit:1090830|GrowthExperiments: set experiment config only in pilot wikis (T379681)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-11-14T14:50:31Z] <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1090830|GrowthExperiments: set experiment config only in pilot wikis (T379681)]] (duration: 13m 02s)

Tentatively resolving. The charts are back to a correct state, see enwiki's.

Screenshot 2024-11-20 at 16.58.49.png (576×1 px, 155 KB)