Page MenuHomePhabricator

Android app data request for captions translated using the suggested edit feature; Add this metric to Monthly Reporting
Closed, ResolvedPublic

Description

Requested by Amanda Bittaker: Can you please share how many captions have been translated using the suggested edit feature? We're writing an initial summary of SDC for the donor and we want to say how many image captions have been translated. (Even though it's not part of the grant, we want to note that it has been enabled by the program.)

Also:
Per Charlotte:
Add monthly translation stat to monthly metric reporting
https://analytics.wikimedia.org/published/datasets/wikipedia-android-app-reports/metrics/2019-12.html

Done:

  • Data for how many captions have been translated using the suggested edit feature
  • Add caption translate to Monthly Report

Event Timeline

Here's where that [[ https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits/Mediawiki_history | mediawiki_history ]] dataset is helpful:

SELECT
  COUNT(1) AS n_caption_translations
FROM `wmf`.`mediawiki_history`
WHERE `snapshot` = '2019-12'
  AND wiki_db = 'commonswiki'
  AND event_entity = 'revision'
  AND ARRAY_CONTAINS(revision_tags, 'android app edit')
  AND INSTR(event_comment, '#suggestededit-translate') > 0
  -- Revisions that haven't been reverted as of the snapshot:
  AND NOT revision_is_identity_reverted
  AND NOT revision_is_deleted_by_page_deletion

At the end of 2019, we had 9848 image captions which have been translated via Suggested Edits (and not reverted).

@Abit as with T242816, we plan to prioritize this at our next board review meeting (this Fri, 17 Jan).

Here's where that [[ https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits/Mediawiki_history | mediawiki_history ]] dataset is helpful:

SELECT
  COUNT(1) AS n_caption_translations
FROM `wmf`.`mediawiki_history`
WHERE `snapshot` = '2019-12'
  AND wiki_db = 'commonswiki'
  AND event_entity = 'revision'
  AND ARRAY_CONTAINS(revision_tags, 'android app edit')
  AND INSTR(event_comment, '#suggestededit-translate') > 0
  -- Revisions that haven't been reverted as of the snapshot:
  AND NOT revision_is_identity_reverted
  AND NOT revision_is_deleted_by_page_deletion

At the end of 2019, we had 9848 image captions which have been translated via Suggested Edits (and not reverted).

Thanks @mpopov - great stuff. What % of image caption translations does that represent between image caption translation feature go-live on Android, and whenever the dataset you've got ends?

At the end of 2019, we had 9848 image captions which have been translated via Suggested Edits (and not reverted).

Thanks @mpopov - great stuff. What % of image caption translations does that represent between image caption translation feature go-live on Android, and whenever the dataset you've got ends?

Just to clarify, 9848 is the total ever from the very first one made during development to the last one made on New Year's Eve. (The "2019-12" in the query refers to the latest available snapshot of mediawiki history, and there will be a new snapshot in February which include image caption translations made this month.)

Added to the monthly reporting, along with a breakdown of title descriptions vs image captions (and also a few fixes). Re-generated December 2019's report card:

MetricDaily averageMonthly total
Micro-contributions made in the app (add, translate, edit)952 (797 descriptions/day, 221 captions/day)260 640 (218 351 title descriptions, 42 289 image captions)
Micro-contributions made in the app via Suggested edits (add, translate)402 (248 descriptions/day, 221 captions/day)109 984 (67 699 title descriptions, 42 285 image captions)
Not-reverted image caption translations made via Suggested Edits-9 848 cumulatively (2 950 just this month)