Background

• Release date: December 1, 2025
• Date that App-install-ID instrumentation was fixed for non-native donations: December 4, 2025
• 15 Days - December 16, 2025 [DONE]
• 3 months - March 4, 2025 (Use app-install-ID start date for this analysis)

The Task

• Compare results to baseline data that was collected
• Visualize and present the data in a way that is easily understandable to the team

Requirements

• The data should be based on the metrics in the Epic

At 3 months

Validation

• KR 1.1 - 5% increase in average donor value for the reminder group donors when compared to traditional maybe later donors over a 3-month period
• KR 1.2 (indicator) Users who see an article-count-based reminder are 50% more likely to complete a donation as compared to those who receive a subsequent banner impression
• KR 1.3 (indicator) 20% of unique users who see an impression of their reminder complete a donation

Guardrails

• GR 2.1 - Total amount raised from reminders over 3 month period is not more than 20% lower than total amount raised from traditional maybe later over a 1 month period
• GR 2.2 - No more than 30% of users who set up a donation reminder turn it off in Settings

Curiosities

• CR 3.1 - Which article and amount combination resulted in the highest donations completion rate?
• CR 3.2 - What share of donors in each group are making multiple donations during the period? What is the average number of donations being made? (Can be approximated with How many uniques clicked "donate" on their reminders more than once? If needed)
• CR 3.3 - What is the donation rate of the 1st view of the reminder, 2nd view, 3rd view, etc. After how many reminders do we see the highest disable rate in settings?
• CR 3.4 - What share of each group are new donors vs repeat donors?
• CR 3.5 - How does our reminder set-up rate compare to the web banner email-entry rate (% of Maybe later clicks on web banners that submit their email)?
• CR 3.6 How does our reminder follow-through rate compare to the donations/email opens for web Remind me later?

At 15 days: [DONE]

Check metric-specific leading indicators to answer hypothesis"
Hypothesis: If we A/B test the customizable donation reminder as an integrated follow-up action to the banner’s Maybe Later action during an active campaign on Android, users who see an article-count-based reminder will be 50% more likely to complete a donation as compared to those who receive a subsequent banner impression.

• KR 1.2 (indicator) Users who see an article-count-based reminder are 50% more likely to complete a donation as compared to those who receive a subsequent banner impression
• KR 1.3 (indicator) 20% of unique users who see an impression of their reminder complete a donation