Page MenuHomePhabricator

Measure topic overlap in translations
Open, NormalPublic

Description

Users trying to translate the same topic at the same brings interesting challenges that can be addressed in different ways. Before we define any collaboration model, some information on how and how much those conflicts are happening can be really useful.

This task proposes to define and implement metrics that inform on how often and in which circumstances the mentioned overlap happens. Some possible signals to base metrics on:

  • Repeated drafts. Drafts that are started on a topic for which there is already another draft for the same language pair. This allows to understand how many users are working on the same time on the same topic.
  • Publishing conflict. An article exists at the time the user tries to publish a translation. It may be interesting to be able to check how many of the "repeated drafts" lead to publishing conflicts, and whether the conflicting article already existed when the translation was started or not.
  • Abandoned drafts. Drafts not edited in a while which have not been published. A reverse "active drafts" can be used instead.

The above signals need to be made specific to become metrics. I expect these metrics to provide us information such as "Few users happen to choose the same topic to translate (5% in general but up to 10% in smaller Wikipedias). From those most (70%) end up in a publishing conflict that we may want to prevent doing X". Note that this is just an example to illustrate how the signals are related, we don't know how big/small the overlap will be.

Event Timeline

Pginer-WMF raised the priority of this task from to Needs Triage.
Pginer-WMF updated the task description. (Show Details)
Pginer-WMF added a subscriber: Pginer-WMF.
Amire80 triaged this task as Normal priority.Jan 15 2015, 8:56 AM
Amire80 set Security to None.
Arrbee raised the priority of this task from Normal to High.Feb 2 2015, 8:10 AM
Arrbee moved this task from Needs Triage to Long term on the ContentTranslation board.
Arrbee lowered the priority of this task from High to Normal.Feb 2 2015, 9:32 AM
Arrbee added a subscriber: Arrbee.
Arrbee moved this task from Long term to CX5 on the ContentTranslation board.Apr 20 2015, 6:06 AM

This does not seem to be in the new set of metrics (T99230) we considered for ContentTranslation-Release6. Given that the former ticket seems to have enough analytics work we may consider (a) not adding this one to the release, or (b) replace other metrics from the former ticket if this one is of higher priority.

Amire80 moved this task from CX5 to CX6 on the ContentTranslation board.Jul 2 2015, 4:32 PM
Amire80 moved this task from CX6 to CX7 on the ContentTranslation board.Oct 2 2015, 2:47 PM
Arrbee moved this task from Bugs to Enhancements on the ContentTranslation board.Jun 22 2018, 1:41 PM
Arrbee moved this task from Bugs to Enhancements on the ContentTranslation board.