Page MenuHomePhabricator

Adjust default MT services for pairs where the default is not the most used
Closed, ResolvedPublic1 Estimated Story Points

Description

Content translation integrates different translation services. A recent analysis (T303812) shows that for some language pairs the default service provided is not the one used the most. This means that most users change the default, indicating their preference for a different one (which can be an indicator of higher MT quality). In those cases we may want to adjust the default service.

The proposed changes are:

  • ru → be to use Yandex
  • pt → gl to use Google
  • en → es to use Google (this adjustment is also covered in T309169)
  • {en, fr, it} → ca to use Google.
  • {ca, en, es, fr, gl} → eu to use Elia

Event Timeline

Pginer-WMF triaged this task as Medium priority.May 26 2022, 7:40 AM
Pginer-WMF moved this task from Needs Triage to MT on the ContentTranslation board.

There was a similar request from Basque Wikipedia editors to have Elia as the default.
The data above shows that Elia is used for 43% of the translations to Basque, while Google is used for 57% (with the advantage of being provided as the default). So it seems that data shows Eli as a possibly preferred option to be the default.

@UOzurumba will check for which source languages makes sense to do the adjustment from those supported by Elia: {ca, en, es, fr, gl} → eu?

Change 805106 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/cxserver@master] WIP: Adjust default MT services for pairs where the default is not the most used

https://gerrit.wikimedia.org/r/805106

KartikMistry set the point value for this task to 1.Jun 14 2022, 12:25 PM

@KartikMistry all pairs pending confirmation have been confirmed. Feel free to complete the deployment when you are available.
Thanks!

@KartikMistry all pairs pending confirmation have been confirmed. Feel free to complete the deployment when you are available.
Thanks!

Thanks! I'll go ahead with deployment this week.

Change 805106 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Adjust default MT services for pairs where the default is not the most used

https://gerrit.wikimedia.org/r/805106

Change 805726 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2022-06-15-074244-production

https://gerrit.wikimedia.org/r/805726

Change 805726 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2022-06-15-074244-production

https://gerrit.wikimedia.org/r/805726

After a few months we will re-run the analysis to check how the usage patterns evolved as part of this ticket: T310773: Re-run and update the MT service usage report