Page MenuHomePhabricator

Develop format for metrics for the language and internationalization newsletter
Closed, DeclinedPublic

Description

The objective of this task is to develop a format for metrics to be included in the language and internationalization newsletter. These metrics will provide insights into the progress and impact of language-related projects and activities.

This task is about developing a format for metrics that will be utilized for reporting on a quarterly basis in the newsletter. This involves selecting the most relevant metrics and establishing a systematic process for reporting. An external reference article shared by @Arrbee serves as a guideline for the format: https://ruralindiaonline.org/en/articles/in-2023-paribhasha-builds-a-peoples-archive-in-peoples-languages/ (first infographic in the article)

Some metrics to consider:

  • CX deletion rates: Use data from Content Translation deletion statistics comparison to analyze and report deletion rates associated with Content Translation.
  • Monthly translations: Monitor and report translation activities on a monthly basis. Note: Significant activity may be observed during specific campaigns, as indicated by the data available here.
  • New translator retention stats: Track the retention of new translators over time to evaluate the effectiveness of retention strategies.
  • Machine translation service use: Particularly focused on languages where the MinT (Machine Translation) service shows lower deletion rates. This metric could provide valuable insights into the effectiveness of machine translation in different language contexts.
  • ....

Event Timeline

KCVelaga_WMF triaged this task as Medium priority.
KCVelaga_WMF moved this task from Triage to Upcoming Quarter on the Product-Analytics board.
KCVelaga_WMF added a subscriber: KCVelaga.
KCVelaga_WMF removed a subscriber: KCVelaga.

Tangential note: https://ruralindiaonline.org/en/articles/in-2023-paribhasha-builds-a-peoples-archive-in-peoples-languages/ is a bad example because of broken rendering in the scripts used in title image - We should never do that.

@srishakatux for a another task (T366044), I have listed all the key metrics that we currently track across three various reports and dashboards.

Please review and let me what you think is useful for the newsletter, and if there is anything additional that might be of interest.

@KCVelaga_WMF / @srishakatux: Hi, the Due Date set for this open task passed a while ago.
Could you please either update or reset the Due Date (by clicking Edit Task), or set the status of this task to resolved in case this task is done? Thanks!

KCVelaga_WMF removed Due Date which was set to Jun 1 2024, 7:00 AM.Jul 19 2024, 4:04 PM

This task is no longer relevant in 2025. Should we consider closing this? @KCVelaga_WMF

declining for now we can possibly revisit later

Sorry, missed the previous ping. That sounds good, and most of the metrics for this kind of reporting will be available with the work of T365813.