Turn off Reply Tool A/B test
Closed, ResolvedPublic
Actions

Description

This task is about turning off the Reply Tool A/B test (T273554) ahead of the New Discussion Tool being made available at the wikis participating in the test (T273554).

Requirements

The A/B test that was turned on in T273554 is turned off.

Where "turned off" in this context means:

New people are NOT being bucketed into test and control groups
The people who had the Reply Tool enabled for them during the test will continue seeing and being able to use the tool
The people who did NOT have the Reply Tool enabled for them during the test will continue seeing the existing, full-page wikitext talk page editing experience

Done

The Requirements above are implemented

Details

Subject	Repo	Branch	Lines +/-
Disable DiscussionTools Reply Tool A/B test	operations/mediawiki-config	master	+0 -22
Allow users to continue using reply tool after disabling A/B test	mediawiki/extensions/DiscussionTools	wmf/1.36.0-wmf.33	+7 -6
Allow users to continue using reply tool after disabling A/B test	mediawiki/extensions/DiscussionTools	wmf/1.36.0-wmf.34	+7 -6
Allow users to continue using reply tool after disabling A/B test	mediawiki/extensions/DiscussionTools	master	+7 -6

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T276497 Scale DiscussionTools to all projects
Open	None	T251207 [Epic] Scale DiscussionTools to all Wikipedias
Open	None	T233446 [Epic] New Discussion Tool
Open	None	T275256 Make New Topic Tool (desktop) available as opt-out feature at all wikis
Resolved	• ppelberg	T275257 Offer New Discussion Tool as Beta Feature at all Wikipedias
Resolved	matmarex	T275827 Deploy config change to scale New Discussion Tool's availability as a beta feature
Resolved	matmarex	T276967 Turn off Reply Tool A/B test

Event Timeline

• ppelberg triaged this task as High priority.Mar 9 2021, 5:29 PM

• ppelberg created this task.

• ppelberg moved this task from Incoming to Ready to Be Worked On on the Editing-team (Kanban Board) board.

Change 670292 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/DiscussionTools@master] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670292

gerritbot added a project: Patch-For-Review.Mar 9 2021, 9:20 PM

Right now disabling the A/B test would disable everything related to it, including disabling the "test" group's access to the reply tool (unless they enabled the reply tool beta feature).

The patch above changes that to allow the "test" group to continue using the reply tool (with the ability to disable it in preferences), but still disable the bucketing and logging.

I'll backport it tomorrow before the config changes.

matmarex moved this task from Ready to Be Worked On to Code Review on the Editing-team (Kanban Board) board.Mar 9 2021, 9:24 PM

Change 670294 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[operations/mediawiki-config@master] Disable DiscussionTools Reply Tool A/B test

https://gerrit.wikimedia.org/r/670294

Scheduled for tomorrow: https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20210310T1900

@ppelberg or @MNeisler: Actually, can you confirm that we want to disable the logging? (that is, logging the 'bucket' field in EditAttemptStep and VisualEditorFeatureUse events)

@matmarex - Yes, confirmed. We can disable logging the event.bucket field as it's no longer relevant since the AB test will be disabled. (cc @ppelberg )

Change 670292 merged by jenkins-bot:
[mediawiki/extensions/DiscussionTools@master] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670292

matmarex mentioned this in rEDTO68ad48f56faf: Allow users to continue using reply tool after disabling A/B test.Mar 10 2021, 6:41 AM

ReleaseTaggerBot added a project: MW-1.36-notes (1.36.0-wmf.35; 2021-03-16).Mar 10 2021, 7:00 AM

Change 670362 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.33] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670362

Change 670363 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.34] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670363

Change 670363 merged by jenkins-bot:
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.34] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670363

Change 670362 merged by jenkins-bot:
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.33] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670362

matmarex mentioned this in rEDTO9cb48f08f452: Allow users to continue using reply tool after disabling A/B test.Mar 10 2021, 7:10 PM

matmarex mentioned this in rEDTO4193ff71df42: Allow users to continue using reply tool after disabling A/B test.

Change 670294 merged by jenkins-bot:
[operations/mediawiki-config@master] Disable DiscussionTools Reply Tool A/B test

https://gerrit.wikimedia.org/r/670294

Mentioned in SAL (#wikimedia-operations) [2021-03-10T19:20:53Z] <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.33/extensions/DiscussionTools/includes/Hooks/HookUtils.php: 4193ff71df421f2fe2ed3e1f2fa1c54334e722e2: Allow users to continue using reply tool after disabling A/B test (T276967) (duration: 01m 09s)

Mentioned in SAL (#wikimedia-operations) [2021-03-10T19:22:16Z] <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.34/extensions/DiscussionTools/includes/Hooks/HookUtils.php: 9cb48f08f452a124868e1bf9d700a45c1d7255f4: Allow users to continue using reply tool after disabling A/B test (T276967) (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2021-03-10T19:23:51Z] <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 4824679d79d462459eba6b77a5af787817f186d2: Disable DiscussionTools Reply Tool A/B test (T276967) (duration: 01m 07s)