####User story & summary:
As a **newcomer** on English Wikipedia, I want access to easy first editing tasks that are structured and help me learn gradually, because I need a chance to gradually learn policies, editing norms, and how to edit.
As an **experienced editor** or **patroller** on English Wikipedia, I want proof that the "Add a link" task is valuable for newcomer activation and retention, because structured tasks are a new editing paradigm that create some additional work for patrollers.
####Background & research:
We have released the "Add a link" Structured task to most Wikipedias as enabled. We feel confident in doing this as we've conducted several A/B tests that show this task is helping new editors get started:
- [[ https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Add_a_link/Experiment_analysis,_December_2021 | Add a link Experiment analysis ]]
- [[ https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Add_an_image/Experiment_analysis,_March_2024 | Add an image (and add a link) experiment analysis ]]
However, we recognize that patrollers are sometimes frustrated with these tasks. We've outlined patroller feedback and some of the improvements we've completed to address concerns: [[ https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Community_feedback | Structured_tasks/Community_feedback ]]
Most Wikipedias have decided that the benefits of this task outweigh the additional burden it places on patrollers. However, at some of our larger wikis, we are first talking about the task with communities and letting communities decide if they want to enable this task. On English Wikipedia, community members asked to scale the task out gradually, so we currently have a natural experiment with a control (newcomers don't receive access to the "Add a Link" Structured Task) and a treatment group (newcomers receive access to the "Add a Link" Structured Task).
####Connection to WMF Annual Plan:
This work relates to the WMF Annual Plan's [[ https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2024-2025/Product_%26_Technology_OKRs#WE_KRs | Wiki Experiences 1.2 Key Result -- Constructive Activation]].
####Related Experiments:
The enwiki experiment is already instrumented and released, and we have conducted similar experiments on our pilot wikis in the past:
- [[ https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Add_a_link/Experiment_analysis,_December_2021 | Add a link Experiment analysis ]]
- [[ https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Add_an_image/Experiment_analysis,_March_2024 | Add an image (and add a link) experiment analysis ]]
- [[ https://docs.google.com/document/d/1fZcDmFbVXE4jqmR_rwMfMydt4gmffWmY_YHHY-qp7-E/edit?tab=t.0 | List of previous Growth experiments ]]
####Previous Add a Link Experiment Analysis links:
- Add a link: experiment T277356
- Add a link: Instrumentation T273827
- Add a link: leading indicators T277355 [[ https://gitlab.wikimedia.org/nettrom/2021-Growth-structured-tasks/-/blob/main/T277355-leading-indicators.ipynb?ref_type=heads | gitlab/T277355-leading-indicators.ipynb ]]
- Add a link: analysis T286816
-- [[ https://gitlab.wikimedia.org/nettrom/2021-Growth-structured-tasks/-/blob/main/T286816-edit-data-gathering.ipynb?ref_type=heads | gitlab/T286816-edit-data-gathering.ipynb ]]
-- [[ https://gitlab.wikimedia.org/nettrom/2021-Growth-structured-tasks/-/blob/main/T286816-user-dataset.ipynb?ref_type=heads | gitlab/T286816-user-dataset.ipynb ]]
####Scope of Analysis [Draft]:
Key Metric:
- **Constructive Activation** (control vs. treatment group on Mobile Web) & (control vs. treatment group on Desktop)
Secondary Metrics:
- **Retention** (control vs. treatment group on Mobile Web) & (control vs. treatment group on Desktop)
- **Revert Rate** (control vs. treatment group on Mobile Web) & (control vs. treatment group on Desktop)
####Acceptance Criteria:
[x] Review experiment and instrumentation to ensure we are collecting the data necessary for experiment analysis.
[x] Discuss scope of the experiment with Growth's PM
[x] Review [[ https://foundation.wikimedia.org/wiki/Legal:Data_Collection_Guidelines | Data Collection Guidelines ]] and obtain/seek L3SC approval as needed
[x] Review [[ https://wikitech.wikimedia.org/wiki/Data_modeling_guidelines | Data Modeling Guidelines ]] as needed
[x] Review [[ https://www.mediawiki.org/wiki/Product_Analytics/Dashboarding_Guidelines | Dashboard(ing) Guidelines ]] as needed
[x] Create Measurement Plan
[x] Post Measurement Plan summary on wiki
[x] Create [[ https://docs.google.com/spreadsheets/d/1ygGZmqyk1OPuB7NggUl9GRfi9zzqIdXENhH_K2Qw87s/edit?gid=0#gid=0 | Instrumentation Plan ]]
[x] QA
[x] Update 2021 notebooks
[x] Code Review: user data gathering, edit data gathering, analysis/modeling by @MNeisler
[x] ✨Perform analysis✨
[x] Prepare [[ https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Jupyter#Quarto | Quarto ]] report
[x] Report review by @MNeisler
[x] Review data [[ https://www.mediawiki.org/wiki/Product_Analytics/Reporting_Guidelines | Reporting guide ]] and [[ https://foundation.wikimedia.org/wiki/Legal:Data_publication_guidelines#Threshold_table | Guidelines ]] to ensure compliance
[x] Review [[ https://www.mediawiki.org/wiki/Product_Analytics/Reporting_Guidelines#Publishing_reports | publishing reports guidelines ]]
[x] Determine and add the appropriate license
[] Enter data publication into the data publication log form registry
[] Post notebooks to [[ https://www.mediawiki.org/wiki/GitLab | Gitlab ]]
[x] Publish the Quarto report following the [[ https://wikitech.wikimedia.org/wiki/Data_Platform/Web_publication | web publishing guidelines ]]
[] Publish the the [[ https://www.mediawiki.org/wiki/GitLab | Gitlab ]] repo link
[] Share findings with Growth team and the Community (either via a summary in this task, or a MediaWiki page).
[] Clear all interim tables and csv files per the [[ https://foundation.wikimedia.org/wiki/Legal:Wikimedia_Foundation_Data_Retention_Guidelines | Data Retention Guidelines ]]