Page MenuHomePhabricator

Growth Team: monitor leading indicators for “Add a Link”
Closed, ResolvedPublic

Description

NOTE: The Growth team will monitor leading indicators using existing Growth KPIs and available metrics via Turnilo, we do not need Product Analytics support to complete this task.
User story & summary:

As the Growth team, I want to check on the "Add a Link" task for a subset of Wikipedias we scale to, because each wiki is unique and it's possible that we will see changes in how this task functions on some wikis.

Context:

The Growth team is scaling the Add a Link structured task to additional Wikipedias. This task has already been A/B tested multiple times with positive results. For this rollout, we only need to monitor a few key leading indicators to confirm the feature is performing as expected post-release.

Leading indicators:
MetricDefinitionExpected Range / Healthy TrendInvestigation TriggerResponsible
Task engagementclicks on an "Add a Link" suggestionShould be similar to previous wikis (of similar size) within ±10%Large drop may indicate task surfacing or UX issueGrowth PM or Product Analytics
Task completioncompleted an "Add a Link" editsShould be similar to previous wikis (of similar size) within ±10%Drop could signal usability or technical issueGrowth PM or Product Analytics
Revert rate% of Add a Link edits revertedShould remain in line with prior benchmarks within ±10%Increase may indicate link quality issueGrowth PM or Product Analytics
Technical errors% of sessions where task fails to load or suggestion fetch fails<95%Increase should trigger engineering checkGrowth Engineers
Acceptance Criteria:
  • Help decide on how to measure impact (pre-post analysis? A/B test?)
  • Complete review of the Leading Indicators for at least three Wikipedias. We should keep this analysis quick, possibly using Growth's public KPIs.
  • Share summary in this task

Related:

Background
This task is important because Add a Link helps new account holders get started:

Event Timeline

KStoller-WMF moved this task from Backlog to Current Quarter Backlog on the Growth-Team board.
KStoller-WMF renamed this task from Product Analytics: Measuring impact of scaling "Add a Link" Structured Task to new Wikipedias to Product Analytics: monitor leading indicators for “Add a Link”.Nov 7 2025, 11:18 PM
KStoller-WMF updated the task description. (Show Details)
KStoller-WMF updated the task description. (Show Details)
KStoller-WMF renamed this task from Product Analytics: monitor leading indicators for “Add a Link” to Growth Team: monitor leading indicators for “Add a Link”.Nov 14 2025, 4:27 PM
KStoller-WMF claimed this task.
KStoller-WMF updated the task description. (Show Details)
KStoller-WMF set Final Story Points to 0.
KStoller-WMF set Final Story Points to .

I've reviewed Add a Link metrics and edits at Japanese Wikipedia, Chinese Wikipedia, and Urdu Wikipedia:

As of Tuesday, December 9th at 23:55 UTC:

Conclusions:

MetricDefinitionExpected Range / Healthy TrendResults
Task engagement rate% of new accounts who click on an "Add a Link" suggestionShould be similar to previous wikis (of similar size) within ±10%Passes (Healthy Trend)
Completion rate% of users who complete an "Add a Link" editShould be similar to previous wikis (of similar size) within ±10%Passes (Healthy Trend)
Revert rate% of Add a Link edits revertedShould remain in line with prior benchmarks within ±10%Passes (Healthy Trend)
Technical errors / task load failures% of sessions where task fails to load or suggestion fetch fails<95%Passes (addressed bug in T412056)
KStoller-WMF updated the task description. (Show Details)