Page MenuHomePhabricator

Identify wikis for New Discussion Tool A/B test
Open, Needs TriagePublic

Description

This task is about identifying the Wikipedias that will participate in the A/B test of the New Discussion Tool.

There are two parts to this task:

  1. Identifying potential wikis for inclusion in the New Discussion Tool A/B test
  2. Confirming with these wikis that they are comfortable participating in the New Discussion Tool A/B test

Selection requirements

The "Candidate wikis" below, collectively, met the following requirements:

  1. There is a large enough number of people editing talk pages each month for the A/B test to reach "significance" in a relatively short amount of time
  2. Wikis whose editors are likely to come from a variety of different locations
  3. Wikis whose editors use a variety of languages and scripts to communicate
  4. Wikis whose monthly talk page editors are comprised of significant numbers of Junior and Senior Contributors
  5. The Reply Tool is already available as an opt-out feature

Candidate wikis

IDWikiCodeLink to on-wiki conversationStatus (e.g. participation confirmed)
1.Amharic Wikipediaamwikimessage
2.Bengali Wikipediabnwikimessage
3.Chinese Wikipediazhwikimessage
4.Dutch WikipedianlwikimessageYes
5.Egyptian Wikipediaarzwikimessage
6.French Wikipediafrwiki
7.Hebrew Wikipediahewikimessage
8.Hindi Wikipediahiwikimessage
9.Indonesia WikipediaidwikimessageYes
10.Italian Wikipediaitwikimessage
11.Japanese Wikipediajawiki
12.Korean Wikipediakowiki
13.Oromo Wikipediaomwiki
14.Persian Wikipediafawiki
15.Polish Wikipediaplwiki
16.Portuguese Wikipediaptwiki
17.Spanish Wikipediaeswiki
18.Thai Wikipediathwiki
19.Ukrainian Wikipediaukwiki
20.Vietnamese Wikipediaviwiki

Note: you might notice this list is identical to the wikis that participated in the Reply Tool A/B test (T267379) with the following exception: the Afrikaans and Swahili Wikipedias are not included because the Reply Tool A/B test data [i] leads us to think there are not enough people using talk pages at these wikis to draw conclusions from the limited usage data. [ii]

Done

  • @MNeisler verifies the ===Candidate wikis will produce a sufficient amount and diversity of usage data for us to draw conclusions from
  • @Whatamidoing-WMF consults with the ===Candidate wikis and documents the wikis that are and are not open to participating in the A/B test in this ticket

i. See Reply Tool AB Test Report
ii. T290204#7356556

Event Timeline

ppelberg renamed this task from Identify wiki candidates for New Discussion Tool A/B test to Identify participating wikis for New Discussion Tool A/B test.Sep 17 2021, 10:56 PM
ppelberg created this task.
ppelberg renamed this task from Identify participating wikis for New Discussion Tool A/B test to Identify wikis for New Discussion Tool A/B test.Sep 17 2021, 11:23 PM
ppelberg updated the task description. (Show Details)
ppelberg added a subscriber: MNeisler.
ppelberg moved this task from Backlog to Triaged on the DiscussionTools board.
ppelberg updated the task description. (Show Details)

The Reply tool is not already deployed to the French Wikipedia. We were delaying that because the wiki is so large. However, I think it is likely to be deployed there fairly soon (before the A/B test is likely to start).

The Reply tool is not already deployed to the French Wikipedia. We were delaying that because the wiki is so large. However, I think it is likely to be deployed there fairly soon (before the A/B test is likely to start).

I'm glad you noted this, @Whatamidoing-WMF; I've added this information to the task description.