As part of the success metrics identified for Content Translation version 2, we want the number of issues that prevent publishing a translation for new editors to decrease.
Measurement
We want to measure the number of errors that hit new editors when they try to publish their translation.
- New editors are defined as users that created their account during the last 6 months (the initial criteria user for new editor experiences research).
- Users may experience multiple errors in a session, we'll capture all of them as different data points.
- We can also distinguish the errors classified by type (e.g., "abuse filter"), and by whether they got later fixed or not.
Representation
An example representation is shown below, where the number of errors is shown over time. Errors are shown per 100 started translations to avoid the fluctuations in the number of translations to affect the numbers.
