Page MenuHomePhabricator

Disable sticky header edit button A/B test for pilot wikis
Closed, ResolvedPublic2 Estimated Story Points

Description

We will disable the A/B test that shows the edit icon in the sticky header for pilot wikis (excluding idwiki/viwiki)

Acceptance criteria

  • Pilot wikis (except for idwiki, viwiki) have sticky header with edit button A/B test disabled
  • Disable Jul 27 << disabled 8/8/22

Event Timeline

Jdlrobson subscribed.

Moving to backlog for prioritization as I assume we won't be doing it the week after turning it on?

ovasileva triaged this task as Medium priority.Jul 13 2022, 9:49 AM
ovasileva subscribed.

Moving back to backlog for next week

Change 817785 had a related patch set uploaded (by Clare Ming; author: Clare Ming):

[operations/mediawiki-config@master] Disable sticky header edit A/B test for pilot wikis

https://gerrit.wikimedia.org/r/817785

cjming moved this task from Doing to Code Review on the Web-Team-Backlog (Kanbanana-2022-23-Q1) board.
ppelberg subscribed.

hey @MNeisler: I'm assigning this task over to you so that you can inform the Web Team directly when they can go ahead with turning of the A/B test.


Context:

Per discussions with @ppelberg, I will check the AB test data logged to date to help inform when the AB test can be turned off. Assigning this task to me for now and will follow-up once I confirm.

MNeisler subscribed.

I've reviewed the Sticky Header AB test events logged to date and confirmed that a sufficient number of editing attempts[i] have been logged to date to complete the analysis of the metrics identified for the AB test in T294506. I believe this AB test can now be turned off.

[i]Across all participating wikis, there have been 1089 clicks to the editing button in the sticky header by 671 distinct users in the test group.

cc @cjming @ovasileva

Change 817785 merged by jenkins-bot:

[operations/mediawiki-config@master] Disable sticky header edit A/B test for pilot wikis

https://gerrit.wikimedia.org/r/817785

Mentioned in SAL (#wikimedia-operations) [2022-08-08T20:11:24Z] <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:817785|Disable sticky header edit A/B test for pilot wikis (T312296)]] (duration: 03m 35s)