Based on the wikis selected in T370622, five new pilot wikis were created on October 14 as part of the Languages onboarding experiment.
The pilot wikis are:
- rskwiki: T374963: Create Wikipedia Pannonian Rusyn
- nrwiki: T375087: Create Wikipedia South Ndebele
- tddwiki: T375422: Create Wikipedia Tai Nüa
- annwiki: T376332: Create Wikipedia Obolo
- ibawiki: T376568: Create Wikipedia Iban
The hypothesis is
If we provide production wiki access to 5 new languages, with or without Incubator, we will learn whether access to a full-fledged wiki with modern features such as those available on English Wikipedia (including ContentTranslation and Wikidata support, advanced editing and search results) aids in faster editing. Ultimately, this will inform us if this approach can be a viable direction for language onboarding for new or existing languages, justifying further investigation.
The pilot wikis went live on 14 October 2024, and by 12 January 2025, we reach the 3 month mark, which is the experiment period.
The primary metric for evaluation is
Mean (average) number of constructive edits per editor per month (in content namespace; neither reverted nor deleted)
In addition, we can also learn about some secondary metrics as listed in the measurement plan.
Steps
- Data gathering for primary metric (due 17 January 2025)
- Data gathering for secondary metrics (due 7 February 2025; paused during LPL offsite)
- Exploratory data analysis of primary and secondary metrics (due
22 January10 Feb 2025) - Modelling and evaluation for primary metric (due 12 February 2025)
- the plan is to use Bayesian hierarchical modeling
- Report compilation (due 14 February 2025)