Page MenuHomePhabricator

Investigate rate at which Senior Contributors abandon New Topic Tool edits
Closed, DeclinedPublic

Description

This task involves the work with calculating the rates at which Senior Contributors in the control group of the New Topic Tool A/B test (T277825) abandon the edits they start with the New Topic Tool.

This information will help us determine whether Seniors Contributors publishing new topics at a lower rate with the New Topic Tool than they do with the existing section=new form [i] is a result of them preferring the legacy experience rather than deficiencies in the New Topic Tool.

Decision to be made

The information this ticket and T306481 is asking for will help the Editing Team decide the people for whom we will propose the New Topic Tool be made available by default as part of T290517.

Requirements

  1. For the buckets of Senior Contributors who completed edits with the New Topic Tool at a lower rate than the existing section=new experience [ii], calculate the rates at which they abandon the edits they start with the New Topic Tool.
    • If time allows, it would be helpful to see the rates at which people abandon the New Topic Tool at the following steps in the publishing flow:
      • After the New Topic Tool appears on someone's screen
      • After the New Topic Tool is loaded and ready for people to type text into it
      • After the someone typed some text into the New Topic Tool
      • After someone attempts to save the topic they drafted
  1. The New Topic Tool AB Test Report: Logged-In User Analysis report is updated with the information gathered in "1."

Done

  • Requirements are met

i. Comment completion rate across all experience levels
ii. This work is being done in T306481

Related Objects

StatusSubtypeAssignedTask
OpenNone
OpenNone
Resolvedppelberg
Resolvedppelberg
Resolvedppelberg
Resolvedppelberg
Resolvedppelberg
DuplicateMNeisler
Resolvedppelberg
Resolved LZaman
ResolvedMNeisler
Resolved Whatamidoing-WMF
Resolvedmatmarex
InvalidNone
Resolvedmatmarex
Resolvedppelberg
Resolvedppelberg
Resolved LZaman
Resolved iamjessklein
DuplicateNone
ResolvedJTannerWMF
ResolvedEsanders
Resolvedppelberg
Resolvedppelberg
Resolved iamjessklein
ResolvedMNeisler
Resolvedppelberg
Resolvedmatmarex
Resolvedmatmarex
ResolvedEsanders
Resolvedmatmarex
Resolvedmatmarex
ResolvedRyasmeen
ResolvedEsanders
Resolvedppelberg
ResolvedEsanders
Resolvedmatmarex
ResolvedUrbanecm
DuplicateNone
Resolvedppelberg
DuplicateNone
ResolvedRyasmeen
Resolvedmatmarex
Resolved Whatamidoing-WMF
Resolvedppelberg
Resolved iamjessklein
Resolvedmatmarex
Resolvedmatmarex
Resolvedppelberg
Resolved iamjessklein
Resolved iamjessklein
ResolvedEsanders
ResolvedEsanders
Resolvedppelberg
Resolvedppelberg
Resolvedmatmarex
Resolvedppelberg
Resolvedmatmarex
ResolvedRyasmeen
Resolvedmatmarex
Resolvedmatmarex
Resolved Whatamidoing-WMF
ResolvedRyasmeen
Resolved Whatamidoing-WMF
Resolvedppelberg
Resolvedmatmarex
Resolvedmatmarex
DeclinedNone
Resolvedppelberg
Resolvedmatmarex
Resolved Whatamidoing-WMF
Resolvedppelberg
Resolvedmatmarex
Resolved Whatamidoing-WMF
Resolvedppelberg
Resolvedppelberg
Resolvedppelberg
Resolvedmatmarex
Resolved Whatamidoing-WMF
ResolvedBUG REPORTmatmarex
Resolvedppelberg
Resolvedppelberg
Resolvedmatmarex
Resolvedppelberg
Resolvedppelberg
ResolvedDLynch
Resolvedppelberg
Resolvedmatmarex
Resolvedppelberg
ResolvedEsanders
Resolvedppelberg
Resolvedppelberg
Resolvedppelberg
Resolvedppelberg
Resolvedppelberg
DeclinedNone
Resolvedppelberg
Resolvedppelberg
Resolvedmatmarex
Resolvedppelberg
Resolvedppelberg
ResolvedFeaturematmarex
Resolvedmatmarex
Resolvedppelberg
Resolvedppelberg
ResolvedMNeisler
Resolvedmatmarex
Resolvedmatmarex
OpenNone
ResolvedNone
Resolvedppelberg
DeclinedMNeisler

Event Timeline

MNeisler edited projects, added Product-Analytics (Kanban); removed Product-Analytics.

On 4 May 2022, @MNeisler and I decided to decline working on this task.

Reason being: T306481 has led us to be confident that people who have made ≥ 2,500 edits being less successful publishing new topics using the New Topic Tool is a signal of Senior Contributors preferring the existing section=new workflow rather than a signal of the New Topic Tool itself not being intuitive enough for Seniors to use.