Page MenuHomePhabricator

Stop AG experiment [tr, en.simple, fr] and switch to enabled by default for junior editors in tr and en.simple
Open, HighPublic4 Estimated Story Points

Description

This task tracks the transition from A/B experiment to production configuration for the three active pilot wikis: Turkish (TR), Simple English (S.EN), and French (FR). The goal is to end the experiment without discontinuity, editors in the treatment group should not experience a gap between the experiment ending and the default experience beginning.

Outcome by wiki

Turkish and Simple English

  • Article Guidance becomes the default workflow for junior editors.
  • Entry points remain the same as during the experiment: red link redirection (both wikis) and the Create New Article CTA on the TR homepage.
  • Experienced editors are not included, AG is not shown to them by default.
  • The workflow remains accessible via the Special:NewArticle special page for all users regardless of experience level.

French

  • The experiment ends and the previous experience is restored.
  • No entry points expose AG (red links no longer redirect to the AG flow).
  • The workflow remains accessible via the Special:NewArticle special page for users who seek it out directly.

Sequencing

The transition must go directly from experiment to instrument/default. Do not stop the experiment before the default configuration is in place, this would create a gap where treatment-group editors lose the experience temporarily.

Step 1: Convert red link redirection from A/B split to configuration driven (TR + S.EN) T433295: Change extension operation mode from experiment to instrument with configurable red link redirection

  • Red links always redirect to AG for junior editors
  • For FR, red links stop redirecting at this point.
  • Default configuration at launch: ON for TR and S.EN, OFF for FR.

Step 2: Instrumentation and data visibility {needs task}

  • Switch data capture from experiment metrics to instrument metrics. This is a consequence of step 1.
  • Build a dashboard to surface this data internally {needs task}

Step 3: Community communication (in parallel with Steps 1–2)

  • Identify the deployment train/date we are targeting.
  • Communicate to TR and S.EN communities: expected switch date and what will change (no more A/B, AG becomes the default for junior editors).
  • For FR confirming the experiment is ending.

Event Timeline

GGalofre-WMF renamed this task from Stop Article Guidance A/B test to Stop AG experiment [tr, en.simple, fr] and switch to enabled by default for junior editors in tr and en.simple.Wed, Aug 26, 11:13 AM
GGalofre-WMF triaged this task as High priority.
GGalofre-WMF updated the task description. (Show Details)
Nikerabbit edited projects, added: LPL sprints (S3 2026 September); removed: LPL sprints.
Nikerabbit set the point value for this task to 4.

Change #1334010 had a related patch set uploaded (by Sbisson; author: Sbisson):

[mediawiki/extensions/ArticleGuidance@master] Replace experiment with instrument and config-driven redirect

https://gerrit.wikimedia.org/r/1334010

Change #1334945 had a related patch set uploaded (by Sbisson; author: Sbisson):

[operations/mediawiki-config@master] ArticleGuidance: Add the redirect configuration keys

https://gerrit.wikimedia.org/r/1334945

Change #1334946 had a related patch set uploaded (by Sbisson; author: Sbisson):

[operations/mediawiki-config@master] ArticleGuidance: Remove the experiment configuration keys

https://gerrit.wikimedia.org/r/1334946

Change #1334010 merged by jenkins-bot:

[mediawiki/extensions/ArticleGuidance@master] Replace experiment with instrument and config-driven redirect

https://gerrit.wikimedia.org/r/1334010

Change #1337983 had a related patch set uploaded (by Sbisson; author: Sbisson):

[mediawiki/extensions/ArticleGuidance@wmf/1.47.0-wmf.19] Replace experiment with instrument and config-driven redirect

https://gerrit.wikimedia.org/r/1337983

Change #1334945 merged by jenkins-bot:

[operations/mediawiki-config@master] ArticleGuidance: Add the redirect configuration keys

https://gerrit.wikimedia.org/r/1334945

Change #1337983 merged by jenkins-bot:

[mediawiki/extensions/ArticleGuidance@wmf/1.47.0-wmf.19] Replace experiment with instrument and config-driven redirect

https://gerrit.wikimedia.org/r/1337983

Mentioned in SAL (#wikimedia-operations) [2026-09-09T13:04:57Z] <sbisson@deploy1003> Started scap sync-world: Backport for [[gerrit:1334945|ArticleGuidance: Add the redirect configuration keys (T434487)]], [[gerrit:1337983|Replace experiment with instrument and config-driven redirect (T434487)]]

Mentioned in SAL (#wikimedia-operations) [2026-09-09T13:09:13Z] <sbisson@deploy1003> sbisson: Backport for [[gerrit:1334945|ArticleGuidance: Add the redirect configuration keys (T434487)]], [[gerrit:1337983|Replace experiment with instrument and config-driven redirect (T434487)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-09-09T13:15:12Z] <sbisson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1334945|ArticleGuidance: Add the redirect configuration keys (T434487)]], [[gerrit:1337983|Replace experiment with instrument and config-driven redirect (T434487)]] (duration: 10m 15s)

With wmf.19 reaching group 2, fr and tr should now be in the desired state.