Page MenuHomePhabricator

WE 2.2.3 Languages onboarding experiment evaluation
Closed, ResolvedPublic

Description

Based on the wikis selected in T370622, five new pilot wikis were created on October 14 as part of the Languages onboarding experiment.

The pilot wikis are:

The hypothesis is

If we provide production wiki access to 5 new languages, with or without Incubator, we will learn whether access to a full-fledged wiki with modern features such as those available on English Wikipedia (including ContentTranslation and Wikidata support, advanced editing and search results) aids in faster editing. Ultimately, this will inform us if this approach can be a viable direction for language onboarding for new or existing languages, justifying further investigation.

The pilot wikis went live on 14 October 2024, and by 12 January 2025, we reach the 3 month mark, which is the experiment period.

The primary metric for evaluation is

Mean (average) number of constructive edits per editor per month (in content namespace; neither reverted nor deleted)

In addition, we can also learn about some secondary metrics as listed in the measurement plan.


Steps

Event Timeline

KCVelaga_WMF moved this task from Incoming to In progress on the LPL Analytics board.
KCVelaga_WMF moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.

Note: I have adjusted the timeline to accommodate a new analysis task: T383868

Update: Data gathering for the primary metric has been completed.

KCVelaga_WMF moved this task from Doing to Needs Review on the Product-Analytics (Kanban) board.

The report has been shared with the team for review. It will be publicly shared after the review.

MaryMunyoki changed the task status from Open to In Progress.Feb 25 2025, 2:39 PM