Turn on the A/A test in production
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	egardner
	Jul 14 2025, 5:27 PM

Description

Once we have the finalized specification (T399347), the instrument (T399482), and confirmation that things are working correctly from the smoke test (T399484), we can actually turn this on in production via a config change.

Open questions

How will users be segmented for this test? Will someone need to handle this manually?
What wikis are we going to run this on?

Acceptance Criteria

Turn on the test for 1-2 small wikis before going to all wikis
A config patch has been merged to enable the test on the participating wikis in production
Any necessary work to bucket users into the test is also accounted for

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
Enable AA test on all wikis	mediawiki/extensions/WikimediaEvents	master	+3 -2
Enable AA test on all wikis	mediawiki/extensions/WikimediaEvents	wmf/1.45.0-wmf.12	+3 -2
Enable AA test on 50 wikis	mediawiki/extensions/WikimediaEvents	wmf/1.45.0-wmf.11	+3 -2
Enable AA test on all wikis	mediawiki/extensions/WikimediaEvents	master	+1 -1

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		None	T399227 [Epic] Perform an A/A test for retention baseline
		Resolved		jwang	T399486 Turn on the A/A test in production

Event Timeline

egardner created this task.Jul 14 2025, 5:27 PM

egardner mentioned this in T399227: [Epic] Perform an A/A test for retention baseline.

egardner mentioned this in T399487: Disable the A/A test in production.Jul 14 2025, 5:32 PM

ovasileva triaged this task as High priority.Jul 22 2025, 4:42 PM

ovasileva set the point value for this task to 1.Jul 22 2025, 4:51 PM

ovasileva moved this task from Incoming/Inbox to Ready on the Reader Growth Team board.

ovasileva updated the task description. (Show Details)Jul 22 2025, 6:24 PM

HSwan-WMF moved this task from Ready to Sprint 2 on the Reader Growth Team board.Jul 23 2025, 4:41 PM

HSwan-WMF edited projects, added Reader Growth Team (Sprint 2); removed Reader Growth Team.

KSarabia-WMF claimed this task.Jul 24 2025, 4:30 PM

Change #1172704 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@master] Enable AA test on all wikis

https://gerrit.wikimedia.org/r/1172704

gerritbot added a project: Patch-For-Review.Jul 25 2025, 7:14 PM

Change #1172704 abandoned by Kimberly Sarabia:

[mediawiki/extensions/WikimediaEvents@master] Enable AA test on all wikis

Reason:

Sorry I changed the wrong file

https://gerrit.wikimedia.org/r/1172704

Change #1172706 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@master] Enable AA test on all wikis

https://gerrit.wikimedia.org/r/1172706

Change #1173421 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@wmf/1.45.0-wmf.11] Enable AA test on all wikis

https://gerrit.wikimedia.org/r/1173421

Change #1173421 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.45.0-wmf.11] Enable AA test on 50 wikis

https://gerrit.wikimedia.org/r/1173421

Mentioned in SAL (#wikimedia-operations) [2025-07-28T20:57:33Z] <cjming@deploy1003> Started scap sync-world: Backport for [[gerrit:1173421|Enable AA test on 50 wikis (T399486)]]

Mentioned in SAL (#wikimedia-operations) [2025-07-28T20:59:28Z] <cjming@deploy1003> ksarabia, cjming: Backport for [[gerrit:1173421|Enable AA test on 50 wikis (T399486)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.11; 2025-07-22).Jul 28 2025, 9:01 PM

Mentioned in SAL (#wikimedia-operations) [2025-07-28T21:06:12Z] <cjming@deploy1003> Finished scap sync-world: Backport for [[gerrit:1173421|Enable AA test on 50 wikis (T399486)]] (duration: 08m 39s)

egardner moved this task from Committed to Code Review on the Reader Growth Team (Sprint 2) board.Jul 28 2025, 11:04 PM

KSarabia-WMF moved this task from Code Review to QA on the Reader Growth Team (Sprint 2) board.Jul 29 2025, 7:16 PM

KSarabia-WMF moved this task from QA to Signoff on the Reader Growth Team (Sprint 2) board.Jul 31 2025, 9:52 PM

Change #1175144 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[mediawiki/extensions/WikimediaEvents@wmf/1.45.0-wmf.12] Enable AA test on all wikis

https://gerrit.wikimedia.org/r/1175144

Change #1175144 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.45.0-wmf.12] Enable AA test on all wikis

https://gerrit.wikimedia.org/r/1175144

Mentioned in SAL (#wikimedia-operations) [2025-08-01T17:27:27Z] <cjming@deploy1003> Started scap sync-world: Backport for [[gerrit:1175144|Enable AA test on all wikis (T399486)]]

Mentioned in SAL (#wikimedia-operations) [2025-08-01T17:29:22Z] <cjming@deploy1003> ksarabia, cjming: Backport for [[gerrit:1175144|Enable AA test on all wikis (T399486)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Change #1172706 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Enable AA test on all wikis

https://gerrit.wikimedia.org/r/1172706

Maintenance_bot removed a project: Patch-For-Review.Aug 1 2025, 5:30 PM

Mentioned in SAL (#wikimedia-operations) [2025-08-01T17:35:34Z] <cjming@deploy1003> Finished scap sync-world: Backport for [[gerrit:1175144|Enable AA test on all wikis (T399486)]] (duration: 08m 06s)