Page MenuHomePhabricator

Turn off Reply Tool A/B test
Closed, ResolvedPublic

Description

This task is about turning off the Reply Tool A/B test (T273554) ahead of the New Discussion Tool being made available at the wikis participating in the test (T273554).

Requirements

The A/B test that was turned on in T273554 is turned off.

Where "turned off" in this context means:

  1. New people are NOT being bucketed into test and control groups
  2. The people who had the Reply Tool enabled for them during the test will continue seeing and being able to use the tool
  3. The people who did NOT have the Reply Tool enabled for them during the test will continue seeing the existing, full-page wikitext talk page editing experience

Done

  • The Requirements above are implemented

Event Timeline

Change 670292 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/DiscussionTools@master] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670292

Right now disabling the A/B test would disable everything related to it, including disabling the "test" group's access to the reply tool (unless they enabled the reply tool beta feature).

The patch above changes that to allow the "test" group to continue using the reply tool (with the ability to disable it in preferences), but still disable the bucketing and logging.

I'll backport it tomorrow before the config changes.

Change 670294 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[operations/mediawiki-config@master] Disable DiscussionTools Reply Tool A/B test

https://gerrit.wikimedia.org/r/670294

@ppelberg or @MNeisler: Actually, can you confirm that we want to disable the logging? (that is, logging the 'bucket' field in EditAttemptStep and VisualEditorFeatureUse events)

@matmarex - Yes, confirmed. We can disable logging the event.bucket field as it's no longer relevant since the AB test will be disabled. (cc @ppelberg )

Change 670292 merged by jenkins-bot:
[mediawiki/extensions/DiscussionTools@master] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670292

Change 670362 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.33] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670362

Change 670363 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.34] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670363

Change 670363 merged by jenkins-bot:
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.34] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670363

Change 670362 merged by jenkins-bot:
[mediawiki/extensions/DiscussionTools@wmf/1.36.0-wmf.33] Allow users to continue using reply tool after disabling A/B test

https://gerrit.wikimedia.org/r/670362

Change 670294 merged by jenkins-bot:
[operations/mediawiki-config@master] Disable DiscussionTools Reply Tool A/B test

https://gerrit.wikimedia.org/r/670294

Mentioned in SAL (#wikimedia-operations) [2021-03-10T19:20:53Z] <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.33/extensions/DiscussionTools/includes/Hooks/HookUtils.php: 4193ff71df421f2fe2ed3e1f2fa1c54334e722e2: Allow users to continue using reply tool after disabling A/B test (T276967) (duration: 01m 09s)

Mentioned in SAL (#wikimedia-operations) [2021-03-10T19:22:16Z] <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.34/extensions/DiscussionTools/includes/Hooks/HookUtils.php: 9cb48f08f452a124868e1bf9d700a45c1d7255f4: Allow users to continue using reply tool after disabling A/B test (T276967) (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2021-03-10T19:23:51Z] <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 4824679d79d462459eba6b77a5af787817f186d2: Disable DiscussionTools Reply Tool A/B test (T276967) (duration: 01m 07s)