Page MenuHomePhabricator

[Epic] Wikipedia Year in Review on iOS App
Open, LowPublic

Description

Background

Year-end reports with insights on user’s habits and achievements have become standard in many apps, such as Spotify and Duolingo. They have the potential to peak user’s curiosity to learn more about their own habits, compare themselves to others, and inspire a deeper connection with the platform.1 2 The Apps teams have created prototypes proving out the concept in 2023, using personalized reading data from the app. Volunteers have also developed a personalized prototype of a year in review for editing. This year, the Web team created an experimental version of a collective year in review during Q1, and the Comms team will continue work on a microsite Wikipedia Year in Review during Q2. The Apps will build off of these with a personalized version in Q2 utilizing locally stored apps data, and a collective version in Q3 building off of the microsite.

This work is part of the FY2425 annual plan Wiki Experiences 3.2 KR to see a 50% increase in the number of donations via touch points outside of the annual banner and email appeals per platform. This is under the Reader and Donor experiences objective 3.

Hypothesis: If we create a Wikipedia in Review experiment in the Wikipedia app, to allow users to see and share personalized data about their reading, editing, and donation habits, we will see 2% of viewers donate on iOS as a result of this feature, 5% click share and, 65% of users rating the feature neutral or satisfactory.

How will we know we were successful

15-day indicators

  • LI 1.1 5% of users opt to learn more about the Wikimedia Foundation (users who clicked on “learn more”/unique users who saw that slide)
  • LI 1.2 Completion rate: at least 20% of users who launch Year in Review view the last slide
  • LI 1.3 At least 10 successful appmenu_yir_iOS donations
  • LI 1.4 What % of users who have the year in review available to them interact with YiR?

Validation

  • KR 1.1 2% of Year in Review those who engaged with the feature donate on iOS as a result of this feature
    • Engaged = unique users who have viewed 2+ slides
  • KR 1.2 5% of users opt to learn more about the Wikimedia Foundation (users who clicked on “learn more”/unique users who viewed donate slides)
  • KR 1.3 5% of users who engaged click share on one or more screen
  • KR 1.4 65% of users who engaged rate the feature neutral or satisfactory
  • KR 1.5 (V2 only) Users that were shown personalized slides rate the feature Satisfactory at a higher rate (more than 10 percentage points higher) than users who were only shown collective slides.

Guardrails

  • GR 1.1 No more than 2% of feedback includes reports of NSFW, Vandalism or Offensive articles referenced in Year in Review.
  • GR 1.2 No more than 5% of users who engaged complain about fundraising components from survey, Donor relations, or support email

Curiosities

  • CR 1.1 How does engagement differ for logged-out users vs logged-in users?
  • CR 1.2 How the average donation amount compare for donations through Year in Review vs Banners?
  • CR 1.3 What % of Year in Review donors were repeat donors vs new donors?
  • CR 1.4 On which slide are users most likely to drop off (close feature using done)?
  • CR 1.5 Did account creations increase as a result of this feature?
  • CR 1.6 Did App installs increase after release of the feature?
Must Haves
  • Share at least 2 personalized insights on App usage or editing for logged-in app users
    • Personalized Insights should cover at least 30 days of activity
  • Share at least 1 insight collective insight for each category: Reading trends, editing trends, Foundation Impact & Fundraising effectiveness for logged-in and logged-out users
  • Allow users to share individual slides
  • Ask satisfaction at the end, and collect text feedback
  • Present opportunity to donate for countries where we accept donations from
  • Ask users to opt-in to more robust tracking for a future iteration in the App
  • Prompt logged-out users to create an account, or log in
  • Where data comes from should be transparent to the user (link to media.wiki page). It should be clear that reading data is only from a user’s App usage, and does not contain reading insights from Web
  • Edits should be confined to Wikipedia edits, and include those made outside the app
  • API calls for Editing Data should not cause strain on core APIs
  • Users should be able to view their year in review multiple times
  • Allow users to dismiss/clear their year in review
  • Label the feature as beta or experimental
  • Feature is fully accessible using dynamic type and VoiceOver
  • Articles that are filtered out of Top Read should also be filtered out of insights
Nice-to-have
  • Compare personalized insights to all App users, or collective insights
  • Personalized Insights cover a longer period of time, ideally the calendar year of 2024
  • The share feature includes a CTA for others to download the iOS App, with a custom app store link for tracking downloads that come from it
User Stories

Primarily

  • As a Wikipedia reader, I want to be visually struck and leave the experience remembering how cool and useful Wikipedia is —inspired and in awe at the breadth and depth of human knowledge that can happen over the course of a year, and ready to give back with a donation.
  • As a Wikipedia reader, I want to see a breakdown of my reading habits in the App, so I share with my quirky Wikipedia reading habits with friends on social media.

Secondarily

  • As an editor on Wikipedia, I want to see insights about my editing contributions to Wikipedia, so I can understand my overall impact this year and share with friends.
Target Quant Regions and Languages
  • Spanish readers and editors in Mexico
  • Italian readers and editors in Italy
  • English readers in Mexico and Italy
Target Qualitative Audience
  • Frequent App users, Readers, especially those that have not previously donated
  • Guardrail Groups
    • Low Bandwidth Readers
    • Blind and Low Vision Users
Designs

T374067: Design Wikipedia Year in Review main flow and actions

References

Related Objects

StatusSubtypeAssignedTask
OpenNone
ResolvedNone
ResolvedHNordeenWMF
OpenNone
ResolvedNone
ResolvedSNowick_WMF
OpenNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedSNowick_WMF
ResolvedNone
ResolvedTsevener
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
DeclinedNone
DeclinedNone
ResolvedNone
ResolvedNone
DuplicateNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
DuplicateNone
ResolvedNone
ResolvedNone
ResolvedNone
OpenBUG REPORTNone
ResolvedNone
DuplicateNone
ResolvedNone
OpenNone
OpenTsevener
OpenNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedHNordeenWMF
ResolvedNone
ResolvedNone
OpenNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedSNowick_WMF
ResolvedNone
ResolvedNone
ResolvedNone
OpenNone
DuplicateNone
OpenNone
ResolvedNone
ResolvedNone
ResolvedNone
ResolvedNone
OpenNone
OpenNone
ResolvedBUG REPORTNone
ResolvedNone

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
HNordeenWMF updated the task description. (Show Details)
HNordeenWMF renamed this task from [Epic] Wikiwrapped on iOS App to [Epic] Wikipedia in Review on iOS App.Sep 17 2024, 9:18 PM
HNordeenWMF updated the task description. (Show Details)
  • Reach out to community to community tech about Xtools
  • Estimate the active editor base of the apps and potential payload frequency.
  • Fuzzing API calls to distribute multiple API calls as its building.
  • Pre-collection of data
  • Speak to SRE

@Seddon :

Estimate the active editor base of the apps and potential payload frequency.

This has already been done by Shay: https://docs.google.com/presentation/d/1mx5Qm2DW-mgsd6NR-gW_toSo5ZL3mc8yA57VG2-A31A/edit#slide=id.g2f3509f15e1_0_0

HNordeenWMF renamed this task from [Epic] Wikipedia in Review on iOS App to [Epic] Wikipedia in Review on iOS App (WiR).Sep 30 2024, 3:20 PM

Has thought been given to the bigger picture, beyond the iOS app? I ask because surely there are other consumers who want this data. It seems we need a centralized "year in review" repository, or something. I envision just a big VPS box (or even prod!) with a message broker that gracefully queues up jobs upon request. Then you can poll until its complete. That's a sort of quick way of doing it, but longer-term maybe it could be built into a MediaWiki extension with action APIs, a Special page with the visualizations, etc.

There's https://wikipediayir.netlify.app/ by @Jdlrobson for example. I'm not sure where the source code is, but it's another example of WiR-type functionality and perhaps a desire to consolidate efforts.

HNordeenWMF renamed this task from [Epic] Wikipedia in Review on iOS App (WiR) to [Epic] Wikipedia Year in Review on iOS App .Oct 4 2024, 3:10 PM

Hey @MusikAnimal, thanks for sharing your vision on this!
This Epic is centered around the experimental personalized Wikipedia in Review that the iOS team plans to build this fall. For chatting about the big picture, I’d invite you to also share your thoughts on in the #wikipedia-yir slack channel so that interested folks can see (there is also the ongoing collective Year in Review project).

Speaking just about what we're hoping to accomplish with the personalized apps version:
The interest that was shown in the prototype of a year in review for editing was definitely part of what motivated us to consider this project for the Reader and Donor Experiences objective! However this first version is not going to be solely editing focused. From a product perspective, only 2% of our users are editors, so we are deliberately trying to keep this first version balanced to include reading insights, editing insights, and movement insights. Once we have some indication of what people are interested in, we would share our results back with the wider P&T group.

For this initial version we are trying to use what we currently have at our disposal for pulling editing insights (as we are planning to show 2 editing insights for the MVP). If initial results are positive and we hear feedback on what folks want to see, we hope this could continue to evolve each year, and our results could help make the case for Principal Engineers getting together to discuss investment in infrastructure that could make editing insights easier for multiple parties to access.