Page MenuHomePhabricator

Implement delayed (edit attempt time) email confirmation enforcement experiment
Open, HighPublic

Description

Instrumentation specification

https://docs.google.com/spreadsheets/d/1UfnYdAspvhkQLzh2iRYX7ystnKXI1loYlVsNcisWALc/edit?gid=0#gid=0

Acceptance criteria

  • Experiment is implemented in code
    • Users in Control (control) group get status quo (default) experience
    • Users in treatment variation group(s) get appropriate changes in experience
    • Experiment tracking key and variation keys are aligned with the values in the linked instrumentation spec
  • Instrumentation spec is implemented and tested
    • experiment_exposure events sent when user experience diverges between variations (see guide)
    • All events in the spec are marked Yes (done)
    • All specified events fire in relevant scenarios and user interactions
    • All events data appears to be accurate and includes all the specified interaction data
  • [If applicable] Instrumentation checks user eligibility in experiment epic (see parent task)
  • Experiment is configured in GrowthBook: https://growthbook.wikimedia.org/experiment/exp_1bfnmuhepfsd#overview
  • Create a Phab task to clean up experiment code after the experiment is over: [Task]

Event Timeline

mpopov assigned this task to Rscout.
mpopov triaged this task as Medium priority.
mpopov raised the priority of this task from Medium to High.
mpopov updated Other Assignee, added: Catrope.

Change #1342325 had a related patch set uploaded (by Catrope; author: Rscout):

[mediawiki/extensions/WikimediaEvents@master] DE 4.3.4 Edit Experiment

https://gerrit.wikimedia.org/r/1342325

Change #1345622 had a related patch set uploaded (by Catrope; author: Catrope):

[mediawiki/extensions/WikimediaEvents@master] Email confirmation: Add server-side enforcement

https://gerrit.wikimedia.org/r/1345622

Change #1345664 had a related patch set uploaded (by Catrope; author: Catrope):

[mediawiki/extensions/WikimediaEvents@master] Email confirmation: Prepare for next experiment

https://gerrit.wikimedia.org/r/1345664

Change #1342325 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Email confirmation: implement delayed enforcement experiment

https://gerrit.wikimedia.org/r/1342325

Change #1345622 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Email confirmation: Add server-side enforcement

https://gerrit.wikimedia.org/r/1345622

Change #1345664 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Email confirmation: Prepare for next experiment

https://gerrit.wikimedia.org/r/1345664

Change #1346327 had a related patch set uploaded (by Catrope; author: Rscout):

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] Email confirmation: implement delayed enforcement experiment

https://gerrit.wikimedia.org/r/1346327

Change #1346328 had a related patch set uploaded (by Catrope; author: Catrope):

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] Email confirmation: Add server-side enforcement

https://gerrit.wikimedia.org/r/1346328

Change #1346329 had a related patch set uploaded (by Catrope; author: Catrope):

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] Email confirmation: Prepare for next experiment

https://gerrit.wikimedia.org/r/1346329

Change #1346327 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] Email confirmation: implement delayed enforcement experiment

https://gerrit.wikimedia.org/r/1346327

Change #1346328 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] Email confirmation: Add server-side enforcement

https://gerrit.wikimedia.org/r/1346328

Change #1346329 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] Email confirmation: Prepare for next experiment

https://gerrit.wikimedia.org/r/1346329

Mentioned in SAL (#wikimedia-operations) [2026-09-30T20:11:34Z] <mstyles@deploy1003> Started scap sync-world: Backport for [[gerrit:1346327|Email confirmation: implement delayed enforcement experiment (T439283)]], [[gerrit:1346328|Email confirmation: Add server-side enforcement (T439283)]], [[gerrit:1346329|Email confirmation: Prepare for next experiment (T439283)]]

Mentioned in SAL (#wikimedia-operations) [2026-09-30T20:31:23Z] <mstyles@deploy1003> mstyles, catrope: Backport for [[gerrit:1346327|Email confirmation: implement delayed enforcement experiment (T439283)]], [[gerrit:1346328|Email confirmation: Add server-side enforcement (T439283)]], [[gerrit:1346329|Email confirmation: Prepare for next experiment (T439283)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-09-30T20:44:22Z] <mstyles@deploy1003> Finished scap sync-world: Backport for [[gerrit:1346327|Email confirmation: implement delayed enforcement experiment (T439283)]], [[gerrit:1346328|Email confirmation: Add server-side enforcement (T439283)]], [[gerrit:1346329|Email confirmation: Prepare for next experiment (T439283)]] (duration: 32m 47s)

Change #1352679 had a related patch set uploaded (by Catrope; author: Catrope):

[mediawiki/extensions/WikimediaEvents@master] Email confirmation: Stop hiding core banner for edit-blocked users

https://gerrit.wikimedia.org/r/1352679

Change #1354421 had a related patch set uploaded (by Phuedx; author: Phuedx):

[mediawiki/extensions/WikimediaEvents@master] ext.wikimediaEvents: Use mw.testKitchen.getExperiment() in emailConfirmationDelayedEnforcement.js

https://gerrit.wikimedia.org/r/1354421

Change #1354421 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] ext.wikimediaEvents: Use mw.testKitchen.getExperiment() in emailConfirmationDelayedEnforcement.js

https://gerrit.wikimedia.org/r/1354421