Background
- Release date: Dec 2, 2025
- 5 funnel day check: Dec 7, 2025 (Separate task)
- 15 Days- Dec 17, 2025
- 30 days - Jan 1. 2026 (separate task)
The Task
- Visualize and present the data in a way that is easily understandable to the team and helps answer the hypothesis
Requirements
- The data should be based on the metrics in the Epic
At 15 days:
Check metric-specific leading indicators: to answer hypothesis
Hypothesis: If we A/B test requiring an account to view the personalized reading insights of Year in Review, we’ll see a 1% increase in overall retention rate for users that were required to have an account, compared to those that were not.
- KR 5.1 - 1% increase in overall app retention among readers who were required to have an account (A) compared to those who did not need to have an account (B).
- We're seeking to understand the impact of requiring Account-holding vs not-account-holding
- Breakdown by logged-in and logged-out for each variant
- KR 5.2 - 10% increase in overall app retention users who were shown personalized slides vs those who were not
- We're seeking to understand the impact of Personalization vs non-personalization
- GR 5.3 - No more than 10% of all survey responses from logged-out users in Group B express concerns with privacy
- CR 5.4 - How does the completion rate, satisfaction rate and donation rate for logged-out users in group A compare to group B?
- We're seeking to understand the impact of Personalization vs non-personalization