Page MenuHomePhabricator

[M] Instrumentation for Year in Review Part 2
Closed, ResolvedPublic3 Estimated Story Points

Description

Background

This task is intended to capture what data wiring is needed to answer if this feature met its goals.

How will we know we are successful
KRs

KR 1.1 2% of Year in Review those who engaged with the feature donate on iOS as a result of this feature Engaged = unique users who have viewed 2+ slides
KR 1.2 5% of users opt to learn more about the Wikimedia Foundation (users who clicked on “learn more”/unique users who viewed donate slides)
KR 1.3 5% of users who engaged click share on one or more screen
KR 1.4 65% of users who engaged rate the feature neutral or satisfactory
KR 1.5 (V2 only) Users that were shown personalized slides rate the feature Satisfactory at a higher rate (more than 10 percentage points higher) than users who were only shown collective slides.

Guardrails

GR 1.1 No more than 2% of feedback includes reports of NSFW, Vandalism or Offensive articles referenced in Year in Review.
GR 1.2 No more than 5% of users who engaged complain about fundraising components from survey, Donor relations, or support email

Curiosities

CR 1.2 How the average donation amount compare for donations through Year in Review vs Banners?
CR 1.3 What % of Year in Review donors were repeat donors vs new donors?
CR 1.4 On which slide are users most likely to drop off (close feature using done)?
CR 1.5 Did account creations increase as a result of this feature? How many of these accounts constructively activated?
CR 1.6 Did App installs increase after release of the feature?
CR 1.7 Compare KR 1.1 donation rate for engaged users in V1 vs donation rate for engaged users in V2

Tasks
  • @Engineers instrument tasks that were accomplished in the remaining feature according to deck
  • Share button tap (Note, we should also make sure we are sharing with a new App Store campaign id in the url)
  • Closing donate slide impression
  • Closing donate slide Donate/Done/Finish buttons, Learn more link
  • Closing donate slide > learn more link > web view impression, donate button tap.
  • Survey impression. survey cancel and submit tap. survey feedback submit data.
  • Mark background of slides green to indicate they have been instrumented

Event Timeline

HNordeenWMF renamed this task from Instrumentation for Wikipedia in Review Sprint 2 to Instrumentation for Year in Review Sprint 2.Oct 4 2024, 3:22 PM
Tsevener renamed this task from Instrumentation for Year in Review Sprint 2 to [S] Instrumentation for Year in Review Sprint 2.Oct 4 2024, 4:18 PM
Seddon set the point value for this task to 1.Oct 9 2024, 12:14 PM
Tsevener renamed this task from [S] Instrumentation for Year in Review Sprint 2 to [S] Instrumentation for Year in Review Part 2.Oct 15 2024, 9:23 PM
Tsevener renamed this task from [S] Instrumentation for Year in Review Part 2 to [M] Instrumentation for Year in Review Part 2.
Tsevener updated the task description. (Show Details)
Tsevener updated the task description. (Show Details)
Tsevener changed the point value for this task from 1 to 3.

Shay is aiming to complete the instrumentation deck by EOD Nov 8th in order to unblock this ticket

Progress is in yir-metrics-2 branch. Moving to blocked while we wait on the final details for the Hide Year in Review settings toggle: https://docs.google.com/presentation/d/1uAiqSlb_vpJsW2KJSM2X38JCDflRTOI2b57ygtad45I/edit#slide=id.g30feed9bed6_0_20

Tsevener updated the task description. (Show Details)

Outcome: YiR Settings toggle work will be done in a separate task.