Page MenuHomePhabricator

Pull data for Watchlist feature after released in production based on measurement and experiment plan November 20 2023
Closed, ResolvedPublic

Description

Background
Once the watchlist feature has been released into production, we need to pull data based on measurement and the experiment plan. This is a post production item and will be based on T334212.

The Task

  • Compare results to baseline data that was collected
  • Visualize and present the data in a way that is easily understandable to the team

Requirements

  • The data should be based on the metrics in the epic T334212

References
The Deep Dive Deck

Details

Due Date
Nov 20 2023, 5:00 AM

Event Timeline

Removing this tag since we haven't released the feature yet

JTannerWMF updated the task description. (Show Details)
JTannerWMF added a subscriber: Dmantena.
JTannerWMF renamed this task from Pull data for Watchlist feature after released in production based on measurement and experiment plan to Pull data for Watchlist feature after released in production based on measurement and experiment plan November 20 2023.Oct 19 2023, 11:31 PM
JTannerWMF assigned this task to SNowick_WMF.
JTannerWMF set Due Date to Nov 20 2023, 5:00 AM.
JTannerWMF updated the task description. (Show Details)

Questions to answer:

How will we know we were successful

  • KR 1.1: 5% increase in edits from experienced editors (50+ Edits)
  • KR 1.2: 10% increase in edit activity from US and Canada
  • KR 1.3: 10% increase in visit to diff pages per unique user
  • KR 1.4: 60% overall satisfaction with feature for experienced editors (Amal user survey)

Other Questions

  • What ratio of users engage with rollback, thank and undo for Android vs. iOS
  • Did we see an increase in users visiting diff pages (new Watchlists entry point)
  • How often are users clicking affordances (buttons on the page) within the diff page
  • Of the people that engaged with Watchlist did we see an increase in edits

@SNowick_WMF / @JTannerWMF: Hi, the Due Date set for this open task passed a while ago.
Could you please either update or reset the Due Date (by clicking Edit Task), or set the status of this task to resolved in case this task is done? Thanks!