Page MenuHomePhabricator

Measure newcomers using Content Translation
Open, MediumPublic

Description

As part of the success metrics identified for Content Translation version 2, we want to get more newcomers using the tool.

Measurement

We want to measure the number of (new) editors that use the tool over time.

  • We want to have separate measurements for (a) "new editors", and (b) "existing editors" as a reference.
  • We want to have separate measurements for activity from (a) all versions, and (b) version 2 of the tool. That will allow to understand the overall impact as version 2 becomes the default but also to "zoom in" to focus only on version 2 (where the improvements are made) when needed.
  • New editors are defined as users that created their account during the last 6 months (the initial criteria user for new editor experiences research). A user starting multiple translations, should be counted only once.
  • Using the tool means to start a translation, which may or may not be completed.
  • Over time: using a periods of 30 days.

Representation

An example representation is shown below, where the evolution in the number of users (newcomers starting at least one translation) is represented over time. For "existing editors", either a separate visualization of the same kind, or a new graph in the same visualisation can be used.

Event Timeline

Restricted Application added a project: ContentTranslation. · View Herald TranscriptMay 14 2018, 10:40 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Pginer-WMF triaged this task as Medium priority.May 14 2018, 5:31 PM
Pginer-WMF moved this task from Needs Triage to CX2 on the ContentTranslation board.

@Pginer-WMF, do you want the Product Analytics team to work on this, T194647, T194648, and T194650? If so, we can definitely consider it although you should note that (1) it may take a few weeks to triage since we're working through a big backlog right now and (2) we'll continue to be very capacity limited until our new data analyst starts, hopefully in 2-3 weeks.

Pginer-WMF updated the task description. (Show Details)May 29 2018, 3:11 PM
Pginer-WMF updated the task description. (Show Details)May 29 2018, 3:14 PM
Pginer-WMF updated the task description. (Show Details)May 29 2018, 3:17 PM
Pginer-WMF updated the task description. (Show Details)May 29 2018, 4:52 PM
Pginer-WMF updated the task description. (Show Details)
Pginer-WMF updated the task description. (Show Details)May 30 2018, 8:59 AM
Vvjjkkii renamed this task from Measure newcomers using Content Translation to m0caaaaaaa.Jul 1 2018, 1:10 AM
Vvjjkkii removed Amire80 as the assignee of this task.
Vvjjkkii raised the priority of this task from Medium to High.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed a subscriber: Aklapper.
CommunityTechBot renamed this task from m0caaaaaaa to Measure newcomers using Content Translation.Jul 2 2018, 5:35 AM
CommunityTechBot assigned this task to Amire80.
CommunityTechBot lowered the priority of this task from High to Medium.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot added a subscriber: Aklapper.
Pginer-WMF updated the task description. (Show Details)Jul 5 2018, 4:41 PM
kzimmerman removed chelsyx as the assignee of this task.Jul 9 2019, 9:20 PM
kzimmerman added subscribers: chelsyx, kzimmerman.

Unassigning @chelsyx because she's moving on from the Foundation.

Restricted Application edited projects, added Product-Analytics; removed Product-Analytics (Kanban). · View Herald TranscriptOct 16 2019, 5:47 PM