Page MenuHomePhabricator

Get Baseline data from Android & Mobile Web for iOS Watchlist
Closed, ResolvedPublic

Description

Background
For the watchlist feature that we are currently working on, we need metrics to inform our design decisions. This data will come from Android which has already implemented the watchlist feature. This data will be used to support our decision making.

The Task

Answer the following questions Android:

  • What % of users have items on their Watchlist?
  • How often do people click Thank, Undo, Share and Rollback (broken down)?
  • How often do users click filter?
  • How often do users click search?

Nice to have

  • Do we see a higher edit rate for users that have items on their watchlist?
  • What is the completion rate for Thank, Undo, and Rollback on Android?

Answer the following questions for Mobile Web:

  • what % of users are visiting diffs
  • what % of users click Thank or Undo

Requirements

  • Propose alternative questions to answer to have a base comparison for Watchlist
  • Update Instrumentation task as needed to collect information
  • Complete baseline metrics by the end of May

References
T335167
T326216

Event Timeline

RWambua-WMF renamed this task from Data Driven decisions for iOS watchlist to Get Baseline data from Android & Mobile for iOS Watchlist .Apr 28 2023, 2:52 PM
RWambua-WMF triaged this task as Medium priority.
RWambua-WMF updated the task description. (Show Details)
JTannerWMF renamed this task from Get Baseline data from Android & Mobile for iOS Watchlist to Get Baseline data from Android & Mobile Web for iOS Watchlist .May 2 2023, 6:19 PM
JTannerWMF updated the task description. (Show Details)

Note for Mobile Web data availability:
What % of users are visiting diffs and What % of users click Thank or Undo were not previously being tracked.
Sam Walton is about to deploy data collection for Special:Diff (T326214) and the same for MobileDiff is in the works (T326216). This will include Thanks, Undo, Rollback and other items

Would like to move first data point ' What is the completion rate for Thank, Undo, and Rollback on Android?' to Nice to have since we are already measuring and have data for 'How often do people click Thank, Undo, Share and Rollback (broken down)?'. Clicks are instrumented in android_breadcrumbs_event but not all events have granularity to track fail/success rates.

Hey @SNowick_WMF, I just added tasks that we are tracking to the reference section of the task.

Note: For Android we will be comparing Undo events originating from Diff/Compare views to iOS Diff Rollback/Undo events using data from mediawiki_history . We will not be comparing events from Mobile Web.