Page MenuHomePhabricator

Conduct 30-day analysis for iOS & Android Year in Reviews
Closed, ResolvedPublic

Description

Background
  • Release date: Dec 2, 2025
  • 5 funnel day check: Dec 7, 2025 (Separate task)
  • 15 Days- Dec 17, 2025 (separate tasks for each app)
  • 30 days - Jan 1, 2026
The Task
  • Create shared deck for iOS & Android results
  • Compare results to baseline data that was collected
  • Visualize and present the data in a way that is easily understandable to the team
Requirements
  • The data should be based on the metrics in the Epic

Validation (the same for both Android & iOS)

  • KR 1.1 - 5% increase in donations app menu donations as compared to a similar time period in 2024.
  • KR 1.2 - 5% increase in return rate for engaged users compared to baseline of 77%.

Guardrails (the same for both Android & iOS)

  • GR 2.1 - Fewer than 50% of feedback about the donation aspects are negative
  • GR 2.2 - At least a 80% of users rate the Year in Review feature as satisfactory or neutral
  • GR 2.4 - At least 10% of engaged users make it to the contributor slides
    • Engaged = viewed at least 2 slides
    • If not met: which slides had the highest drop off?

Curiosities (the same for both Android & iOS)

  • CR 3.1 What were the main themes in the user feedback from the Year in Review survey? Did we see a decrease in requests for personalization from 2024?
  • For iOS, did we see differences among Logged-in vs logged-out, and group A vs B?
    • Baseline: Last year, 60% of free-text responses asked for personalization.
  • CR 3.2 - By how much did Year in Review increase overall app account creations? (% increase)
    • What was the quality of the new users? (ie. did they retain at a higher or lower rate than other users).
  • CR 3.3 - How do the donations received through Year in Review differ from other app menu donations, and banner donations? Average gift, share of new donors
    • App menu donations from a comparable time period (when YiR is not running)
  • CR 3.4 - What was the overall donation rate? and which 2 slides had the highest donation rate?
  • CR 3.5 - How many people shared their highlights? What was the most commonly shared individual slide?
  • CR 3.6 - What share of engaged users with year in review enabled the custom icon (in settings for from within the feature)?
  • CR 3.7 How many new users came in through Year in Review share links, and did we see a bump in overall new users that we can attribute to YiR?
  • CR 3.8 - Did we see a change in overall app retention rate Year over Year?

Notes for presentation

  • Share account creation graph
  • Work with growth/editing teams to learn what those editors went on to do editing-wise

Event Timeline

HNordeenWMF triaged this task as Medium priority.
HNordeenWMF moved this task from Needs Triage to Up Next on the Wikipedia-Android-App board.
HNordeenWMF moved this task from Needs Triage to Up next on the Wikipedia-iOS-App board.
SNowick_WMF claimed this task.