Page MenuHomePhabricator

Allow to assign an experiment variant to existing account holders
Open, HighPublic

Description

The T365889: [EPIC] Community updates module: instrumentation & measurement (SDS 2.1.3) plan includes experimenting on existing account holders to measure the impact of the module in terms of editor retention. In order to do so we need to be able to assign a random variant to existing users with growth experiments enabled. Currently the variant is stored using the MW user option growthexperiments-homepage-variant and its default value is control.

Ideally the bucket distribution would take in account GE config wgGEHomepageNewAccountVariantsByPlatform which allows to define different probability per bucket and platform

Acceptance criteria

  • Existing account holders with GE can be assigned to an experiment variant
  • Nice to have: the probability of each bucket can be defined similar to the existing GE config which applies to newly registered accounts

Event Timeline

Sgs triaged this task as High priority.Wed, Oct 2, 10:13 AM
Sgs created this task.

Change #1077357 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/core@master] [WIP] ConditionalDefaultsLookup: add CUCOND_BUCKET condition

https://gerrit.wikimedia.org/r/1077357

Change #1077921 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/GrowthExperiments@master] [WIP] VariantHooks: remove onUserGetDefaultOptions for default variant assignment

https://gerrit.wikimedia.org/r/1077921

Change #1080055 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/core@master] ConditionalDefaultsLookup: add an accumulator per option evaluation

https://gerrit.wikimedia.org/r/1080055

Change #1080055 abandoned by Sergio Gimeno:

[mediawiki/core@master] ConditionalDefaultsLookup: add an accumulator per option evaluation

Reason:

Not needed, using accumulated probability in I4bf8cec6de4082ef3240a1f3fa3848eda04bc008

https://gerrit.wikimedia.org/r/1080055

Change #1077921 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] ExperimentsUserDefaultsManager: introduce user bucketing condition

https://gerrit.wikimedia.org/r/1077921

Sgs renamed this task from Assign an experiment variant to existing account holders to Allow to assign an experiment variant to existing account holders.Thu, Oct 17, 10:03 AM
Sgs updated the task description. (Show Details)
Sgs moved this task from Code Review to QA on the Growth-Team (Current Sprint) board.