As part of the [[ https://www.mediawiki.org/wiki/Content_translation/V2/Roadmap#Measuring_success | success metrics identified ]] for Content Translation version 2, we want the success rate for new editors using the tool to increase.
# Measurement
We want to measure **the percentage of translations by (new) editors that are completed successfully**.
- We want to have separate measurements for (a) "new editors", and (b) "existing editors" as a reference.
- Success levels: We want to capture the translations that resulted in a published article (success), those that were not published because an error prevented from publishing, and those where users just abandoned the process and leave the translation incomplete for the given time period (i.e. the user started the translation but didn't pressed "publish").
- New editors ("Newbie editor") are defined based on the [[ https://www.mediawiki.org/wiki/Analytics/Metric_definitions | standard metric definitions ]] as "a person who has made fewer than 10 edits on the specific Wikimedia wiki in total". A user starting multiple translations, should be counted only once.
- Time period: We want to group the results in 30 day periods. Analysing the translations that were started in a given month. We may need to consider a delay to give enough time to be sure that "abandoned" translations are not misclassified.
# Representation
An example representation is shown below, where the percentage of successfully published translations increases over time, as errors and abandoned translations decrease. The graph shows, regardless the number of new users or the translations they make, how likely they are to succeed or face problems.
{F18250645, size=full}