Page MenuHomePhabricator

[Sub-epic] YiR Reading List A/B Test
Open, MediumPublic

Description

Background

As part of the annual plan, we are testing an improvement to Year in Review, to learn if it results in an increase in overall app retention for logged-in users. We heard during user testing of the Year in Review that many users were not interested in/motivated by the custom app icon. We also heard requests in last year's iOS Year in Review for a reading list based on their year in review. We plan to build an experimental version of the Year in Review reading list, to see if users are interested in receiving this type of reward after the Year in Review.

Our hypothesis is: If we release Year in Review on Android and A/B test offering engaged users a reward to save a custom reading list, we will see a 1% increase in overall app retention rate amongst readers offered the reward compared to those who were not.

Possible user stories
  • As a power-Wikipedia user, I want to receive a list of articles related to my reading in 2025, so I can discover more things to read.
  • ✅ [Primary] As a Wikipedia reader, I want a record of the articles I read the longest in 2025, so I can remember this time looking back.
Requirements
  • Run as an A/B test: 50% of users receive reading list, 50% do not
  • Available only to logged-in users
  • Copy or branding should indicate that this is related to the Year in Review
  • Only show to people after they have viewed at least 1 slide of the Year in Review
    • Does not have to be offered within the same session, can be offered in a later open of the app
    • Stop showing entry point after March 31, 2026
  • Do not show to people who have Year in Review turned off in Settings
  • Offer the reading list within "Saved"
  • Show an active state on “Saved” navigation tab
  • Upon opening “Saved”, users see a Dialog:
    • Copy (Draft)
      • Create your Year in Review 2025 reading list?
      • Wikipedia Year in Review will create a reading list of the articles you spent the most time with in 2025.
    • Create > Reading list automatically appears in Saved
    • No thanks > dismisses dialog
  • Display the "New" marker on the reading list once it is saved
  • How articles are selected
    • Show the articles they read the longest in Minutes from their history
    • Show a maximum of 25 articles, minimum of 5 articles
  • After the reading list is saved, it should operate like any other reading list
    • Title "Year in Review 2025"
    • Description: Articles you spent the most time with in 2025
  • Include a survey to get feedback on the reading list
Designs

https://www.figma.com/design/DHj33gafvUmkiUahLSJgIM/Android---%3E-Year-in-Review-v3?node-id=643-5017&p=f&t=7Qp5gfXgiwBs7O2P-0

Reference

Event Timeline

HNordeenWMF triaged this task as Medium priority.

Questions:

Only show to people after they have viewed at least 1 slide of the Year in Review

  1. Does the dialog show up within the session of YiR? Or is it still available after the YiR session if the user reaches the requirement?

Reading list should be populated with at least 25 articles

  1. What is the maximum number of articles we should set?
  2. If the generated articles are fewer than 25 articles, do we need to fill in articles from local history to make it 25?

After the reading list is saved, it should operate like any other reading list

  1. This is feasible, but we will need copies of the reading list title and the description.
HNordeenWMF renamed this task from [Sub-epic] YiR: Create reading list A/B Test to [Sub-epic] YiR Reading List A/B Test.Fri, Oct 17, 5:59 PM