Update Measurement Plan and Instrument GPay
Closed, ResolvedPublic
Actions

Description

Background

We are adding native GPay into the Android App so that donors can give without leaving the App. We plan to measure its impact on overall donation completion rate, and verify if it is providing a more streamlined donation experience in the App.

Tasks

Augment Android measurement plan and instrumentation docs to include Android GPay donor events based on screens from Figma / Design ticket: T362698
Instrument GPay based on Doc from Shay, ensure it is released along with first rollout to Japan
Create data validation task

How we'll measure success

Plan to report on specific metrics for GPay:

Indicator: 30% higher donation completion rate (Success rate %) for donations made through Native GPay as compared to web view donations (all payment types)
Indicator: 25% increase in donation completion rate (Success rate %) for all donations made in Android app during campaign as compared to previous year (Use Japan Campaign from this year & last year)
Curiosity: What percentage of users use native payment GPay compared to GPay on Web?
Curiosity: How did the share of GPay donations as a portion of all Android donations change? (compare to last campaign, or before and after of Apps Menu donations)
Guardrail: Abandonment rate is no more than 25%

Related Objects
Search...

Status	Assigned	Task
Resolved	JTannerWMF	T344004 [Main Epic] Improve Donor experiences in the apps
Resolved	Dbrant	T361119 [Sub Epic] As a donor I want to be able to donate via GPay in the Android App
Resolved	Dbrant	T363194 Update Measurement Plan and Instrument GPay
Resolved	SNowick_WMF	T364183 Data validation for GPay

Event Timeline

SNowick_WMF created this task.Apr 23 2024, 4:57 PM

SNowick_WMF removed a project: Wikipedia-iOS-App-Backlog (iOS Release FY2023-24).Apr 23 2024, 6:08 PM

HNordeenWMF edited parent tasks, added: T361119: [Sub Epic] As a donor I want to be able to donate via GPay in the Android App; removed: T344004: [Main Epic] Improve Donor experiences in the apps.Apr 23 2024, 10:57 PM

HNordeenWMF updated the task description. (Show Details)Apr 24 2024, 6:49 PM

HNordeenWMF updated the task description. (Show Details)Apr 24 2024, 6:52 PM

HNordeenWMF updated the task description. (Show Details)Apr 24 2024, 10:15 PM

AKanji-WMF added subscribers: AKanji-WMF, spatton.Apr 25 2024, 3:48 PM

HNordeenWMF updated the task description. (Show Details)Apr 25 2024, 5:51 PM

HNordeenWMF moved this task from Epics in Progress to Needs Analytics on the Wikipedia-Android-App-Backlog (Android Release - FY2023-24) board.Apr 25 2024, 6:30 PM

HNordeenWMF updated the task description. (Show Details)Apr 26 2024, 11:00 PM

HNordeenWMF updated the task description. (Show Details)Apr 30 2024, 4:54 PM

HNordeenWMF mentioned this in T363782: Add feature flag to limit Native GPay release to Japan.

HNordeenWMF renamed this task from Augment Android measurement plan and instrumentation docs to include Android GPay donor events to Update Measurement Plan and Instrument GPay.Apr 30 2024, 5:15 PM

HNordeenWMF updated the task description. (Show Details)

Instrumentation for GPay has been added to main instrumentation doc Slides 18-22. Note: DB had suggested we use the breadcrumbs table for this but doing so would put all our event data for this one engagement into a separate table, similar events already exist for iOS in the app_donor_experience dataset which we will need to compare so it just makes sense to keep them all in one place.

Thanks @SNowick_WMF! This task can be repurposed for engineers to implement the GPay instrumentation above.

HNordeenWMF updated the task description. (Show Details)May 3 2024, 11:15 PM

HNordeenWMF removed SNowick_WMF as the assignee of this task.May 3 2024, 11:28 PM

HNordeenWMF updated the task description. (Show Details)

Dbrant claimed this task.May 4 2024, 12:16 PM

Dbrant triaged this task as Medium priority.

Dbrant moved this task from Ready for dev to Code Review on the Wikipedia-Android-App-Backlog (Android Release - FY2023-24) board.

@SNowick_WMF will you be using the metrics platform data contract for this measurement? Or are you repurposing an existing instrument?

HI @VirginiaPoundstone the rest of these events are already instrumented on MEP so we will be using that schema (app_donor_experience). We are adding a new user payment method to already existing user flows.