Data requests for Android
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• scblr
	Sep 2 2019, 2:15 PM

Description

Add metrics to analytics.wikimedia.org/datasets/wikipedia-android-app-reports

We’re very much appreciating the report that @mpopov put together and would like to enhance it with the following metrics:

Explore feed

Total number of unique users that view the “Add/translate image captions” Explore feed card suggestions (Daily average | Monthly total) 
Total number of unique users that tap the “Add/translate image captions” Explore feed card suggestions (Daily average | Monthly total) 
Total number of unique users that complete an “Add/translate image caption” edit with Explore feed card suggestions (Daily average | Monthly total)

Total number of unique users that view the “Add/translate article descriptions” Explore feed card suggestions (Daily average | Monthly total) 
Total number of unique users that tap the “Add/translate article descriptions” Explore feed card suggestions (Daily average | Monthly total) 
Total number of unique users that complete an “Add/translate article descriptions” edit with Explore feed card suggestions (Daily average | Monthly total)

Image captions

Total number of image caption edits in the app (Daily average | Monthly total)
Total number of image caption edits via Suggested edits (Daily average | Monthly total)
Total number of unique users that have made an image caption edit in the app (Daily average | Monthly total)
Total number of unique users that have made an image caption edit via Suggested edits (Daily average | Monthly total)
Total number of unique users that view the article header image CTA for image captions (Daily average | Monthly total)
Total number of unique users that tap the article header image CTA for image captions (Daily average | Monthly total)
Total number of unique users that complete an edit with the article header image CTA for image captions (Daily average | Monthly total)
Total number of unique users that view editing CTA in the gallery view (Daily average | Monthly total)
 Total number of unique users that tap on an editing CTA in the gallery view (Daily average | Monthly total)
 Total number of unique users that complete an edit with a gallery CTA for image captions (Daily average | Monthly total)

Article descriptions

Total number of unique users that have made an article description edit in the app (Daily average | Monthly total)
Total number of unique users that have made an article description edit via Suggested edits (Daily average | Monthly total)

Reverts

Total number of app edits that have been reverted
Total number of app image caption edits that have been reverted
Total number of article description edits that have been reverted

Total number of unique users with one or more reverted app edit
Total number of unique users with revert rate in the ranges: 0-1%, 1-2%, 2-3%, 3-4%, 4-5%, 5-7%, 7-10%, 10%+

Related Objects
Search...

Status	Assigned	Task
Resolved	SNowick_WMF	T231818 Data requests for Android
Resolved	cchen	T232765 Count of users who have a reverted suggested edit
Resolved	SNowick_WMF	T239706 Count edits/users for “Suggested edits” explore feed and article/gallery CTA
Resolved	Dbrant	T240469 Track source of in-app Wikidata description edits

Event Timeline

• scblr created this task.Sep 2 2019, 2:15 PM

• scblr updated the task description. (Show Details)Sep 2 2019, 2:20 PM

@schoenbaechler This will have to wait until we hire an analyst to help support apps. However, let me know if there is something particularly urgent that a product decision is resting on and I'll see if we can help out.

kzimmerman triaged this task as Low priority.Sep 3 2019, 5:48 PM

kzimmerman moved this task from Triage to Icebox on the Product-Analytics board.

• scblr mentioned this in T228845: [EPIC] Suggested edits V3.Sep 4 2019, 10:58 AM

• scblr updated the task description. (Show Details)Sep 10 2019, 9:28 AM

Hi @kzimmerman - there are indeed urgent things that a product decision is indeed resting on. Happy to talk through this in our call tonight.

Urgent priority: making a decision on the revert thresholds for pausing the SE feature

Total number of unique users with one or more reverted app edits
Total number of unique users with a revert % higher than 3%
Total number of unique users with a revert % higher than 5%

High priority: understanding the efficacy of our various editing CTAs

Total number of unique users that view the article header image CTA for image captions (Daily average | Monthly total)
Total number of unique users that tap the article header image CTA for image captions (Daily average | Monthly total)
Total number of unique users that complete an edit with the article header image CTA for image captions (Daily average | Monthly total)

Total number of unique users that view editing CTA in the gallery view (Daily average | Monthly total)
Total number of unique users that tap on an editing CTA in the gallery view (Daily average | Monthly total)
Total number of unique users that complete an edit with a gallery CTA for image captions (Daily average | Monthly total)

Total number of unique users that view the “Add/translate article descriptions” Explore feed card suggestions (Daily average | Monthly total)
Total number of unique users that tap the “Add/translate article descriptions” Explore feed card suggestions (Daily average | Monthly total)
Total number of unique users that complete an “Add/translate article descriptions” edit with Explore feed card suggestions (Daily average | Monthly total)

Total number of unique users that view the “Add/translate image captions” Explore feed card suggestions (Daily average | Monthly total)
Total number of unique users that tap the “Add/translate image captions” Explore feed card suggestions (Daily average | Monthly total)
Total number of unique users that complete an “Add/translate image caption” edit with Explore feed card suggestions (Daily average | Monthly total)

• Charlotte updated the task description. (Show Details)Sep 10 2019, 3:44 PM

@Charlotte Added to our agenda!

Charlotte looked at background rates of reverts in the app, and for now set 5 as threshold for turning off the suggested edits feature.
To help prioritize the development needed to change the threshold, Charlotte needs to know the "Total number of unique suggested edit users with a reverted suggested edit".

kzimmerman renamed this task from Add metrics to analytics.wikimedia.org/datasets/wikipedia-android-app-reports to Data requests for Android.Sep 12 2019, 5:44 PM

kzimmerman added a project: Epic.

kzimmerman updated the task description. (Show Details)

Broke out the most urgent request here: T232765

kzimmerman closed subtask T232765: Count of users who have a reverted suggested edit as Resolved.Oct 1 2019, 3:29 PM

SNowick_WMF closed subtask T239706: Count edits/users for “Suggested edits” explore feed and article/gallery CTA as Resolved.Feb 13 2020, 4:39 AM

SNowick_WMF updated the task description. (Show Details)Jun 18 2020, 9:26 PM

SNowick_WMF claimed this task.May 24 2021, 4:46 PM

This was resolved by @mpopov's Baseline Metrics reporting which is now deprecated. We will revisit the need for the metrics listed in this request when we develop a reporting replacement in the future.

Data requests for AndroidClosed, ResolvedPublicActions