Page MenuHomePhabricator

Visualize Content Translation funnel to better understand different translator paths
Open, HighPublic

Description

Users move through different paths when using content translation, and we want to have a better understanding about how many users take each path and the results they produce.

Translators can enter the tool through different entry points (Contributions page/menu, interlanguage links, etc.), start a translation in different ways (searching for a specific article, picking a suggestion, or selecting an article they kept for later), and advance through different stages for the translation (starting a new translation, continuing an existing one, and publishing). Finally, the published content may survive, be edited further, or be deleted by the community.

Measuring and visualizing this funnel would allow understanding better which paths are used the most and which ones lead to more productive activities.

We are interested in both, the overall activity for any language as well as the activity for specific wikis. Ideally, it would be great to focus on any particular wiki, but if a predefined set is needed we'd focus on the selected small Wikipedias (Bengali, Malayalam, Tagalog, Javanese, and Mongolian).

An initial diagram illustrating the user workflow and possible steps to instrument is captured below:

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 27 2019, 1:23 PM
Pginer-WMF renamed this task from Measure Content Translation funnel to Visualize Content Translation funnel to better understand different translator paths.Aug 27 2019, 1:24 PM
Pginer-WMF added a project: CX-boost.
Pginer-WMF triaged this task as Medium priority.Aug 29 2019, 10:19 AM
Jpita added a subscriber: Jpita.Oct 9 2019, 10:01 AM

We should have metrics in place to understand the user workflow when it comes to the use of multi-publish:

  • User loads draft directly - by the use of a bookmark the user might publish a partial translation and then go directly to the same translation to complete it
  • User uses the published section of the dashboard - metrics for clicks on Published plus metrics on continue translation button
  • User starts a new translation of an existing article - metrics for overrides of published articles for the same user
  • User starts a new translation of an existing article - metrics for overrides of published articles for a different user

Another relevant aspect to capture could be the time it takes to complete the steps (in time or number of sessions). So the measurement proposed for T243387 can be also integrated here.

Pginer-WMF raised the priority of this task from Medium to High.Apr 16 2020, 8:35 AM
Pginer-WMF updated the task description. (Show Details)Apr 16 2020, 5:17 PM
Pginer-WMF updated the task description. (Show Details)Apr 29 2020, 3:47 PM

This is a pretty awesome diagram! I know all of these points, but I didn't realize there are so many of them.