Task
15 Day Analysis
Date Start: August 28 into Production
Date End: September 12
Compare pre-post release data:
Pre release: 50600-r-2026-07-28
Post release: 50603-r-2026-08-25
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T420788 [Epic] Android Reading list updates 26-27 | |||
| Resolved | SNowick_WMF | T435667 Android Reading Lists Update Analysis |
Event Timeline
Comment Actions
Android Reading Lists Update 15 Day Analysis T420788
KR 1: 1% increase in 2nd-day FEATURE retention saved reading lists feature overall after release, compared to before release.
Result: We saw a decrease of -6% for Saved feature return rate between pre and post update release users.
GR 1: No more than 10% decrease in share of users that engage with Saved after release vs before release.
Result: Saved Engaged rate was 3.9% of unique users before the update and 3.8% after. That is a −3.8% relative change (0.15 percentage points). Practically flat.
CR 1: Did we see a change in overall 2nd-day app retention for the cohort of users that engaged with saved reading lists before release versus after?
Result: We saw -12% decrease in app retention for post update Saved Reading List engaged users
CR 2: Did we see a change in overall 2nd-day app retention before release versus after?
Result: We saw a decrease of -1.7% in overall app retention from post Reading List update uniques