Page MenuHomePhabricator
Create Task
Maniphest T309384

Enable Content and Section translation on wikipedias with new MT support from Flores
Closed, ResolvedPublic1 Estimated Story Points
Actions

Description

A set of languages without previous machine translation support will get support from Flores (T307970). Once they have MT support, exposing more the possibility to translate articles may be convenient. This ticket proposes to enable Content and Section Translation and improve template support for these languages:

  • ast (Asturian)*
  • ckb (Sorani / Central Kurdish)*
  • ilo (Iloko)
  • kg (Kongo)
  • ln (Lingala)
  • nso (Northern Sotho)
  • ss (Swati)
  • tn (Tswana)
  • zh-yue (Cantonese) (will be done later as separate ticket: T304865)
  • om (Oromo)*
  • wo (Wolof)
  • ay (Aymara, supported by Flores as Central Aymara: ayr)

*Some wikis have Content Translation already as default, but Section Translation enablement is pending.

As part of this process, we want to learn from the editing community how well those tools suit their needs and identify potential improvements. We'll communicate with the editing community and only proceed with the enablement if there is no major concern.

Steps:

  • Enable ContentTranslation out of Beta for ay, ilo, kg, ln, nso, ss and tn Wikipedias
  • Enable in the selected Wikipedias

Details

Other Assignee
UOzurumba
SubjectRepoBranchLines +/-
Enable ContentTranslation out of Beta for sswikioperations/mediawiki-configmaster+0 -1
Enable ContentTranslation out of Beta for ay, ilo, kg, ln, nso, and tn Wikipediasoperations/mediawiki-configmaster+0 -7
Enable Content and Section translation on WPs with NLLB-200 MT supportoperations/mediawiki-configmaster+12 -1
testwiki: Enable SectionTranslation for 11 Wikipediasoperations/mediawiki-configmaster+1 -1
Update cxserver to 2022-06-15-074244-productionoperations/deployment-chartsmaster+1 -1
Update template parameter alignments for 10 language pairsmediawiki/services/cxservermaster+0 -0
Customize query in gerrit

Related Objects

Event Timeline

Pginer-WMF created this task.May 27 2022, 9:52 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 27 2022, 9:52 AM
Pginer-WMF updated the task description. (Show Details)May 31 2022, 9:12 AM
Pginer-WMF triaged this task as Medium priority.May 31 2022, 9:17 AM
Pginer-WMF mentioned this in T307970: Deploy Flores Machine Translation in a new set of Languages.May 31 2022, 10:38 AM
• Nikerabbit moved this task from Needs Triage to MT on the ContentTranslation board.Jun 6 2022, 11:29 AM
KartikMistry changed the task status from Open to In Progress.Jun 6 2022, 4:27 PM
KartikMistry moved this task from Quarter Backlog to In Progress on the Language-Team (Language-2022-April-June) board.
Pginer-WMF assigned this task to KartikMistry.Jun 9 2022, 8:19 AM
KartikMistry updated Other Assignee, added: UOzurumba.Jun 14 2022, 11:13 AM
KartikMistry updated the task description. (Show Details)
KartikMistry set the point value for this task to 1.
KartikMistry added a comment.Jun 14 2022, 11:37 AM

Result of template parameter alignment mapping:

sqlite> select count(*) from templates where source_lang='en' and target_lang='ast';
69
sqlite> select count(*) from templates where source_lang='en' and target_lang='ilo';
65
sqlite> select count(*) from templates where source_lang='en' and target_lang='kg';
0
sqlite> select count(*) from templates where source_lang='en' and target_lang='ln';
2
sqlite> select count(*) from templates where source_lang='en' and target_lang='nso';
6
sqlite> select count(*) from templates where source_lang='en' and target_lang='ss';
4
sqlite> select count(*) from templates where source_lang='en' and target_lang='tn';
7
sqlite> select count(*) from templates where source_lang='en' and target_lang='om';
5
sqlite> select count(*) from templates where source_lang='en' and target_lang='wo';
4
sqlite> select count(*) from templates where source_lang='en' and target_lang='ay';
0
gerritbot added a comment.Jun 14 2022, 11:44 AM

Change 805366 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/cxserver@master] Update template parameter alignments for 10 language pairs

https://gerrit.wikimedia.org/r/805366

gerritbot added a project: Patch-For-Review.Jun 14 2022, 11:44 AM
KartikMistry updated the task description. (Show Details)Jun 14 2022, 12:03 PM
gerritbot added a comment.Jun 14 2022, 12:16 PM

Change 805366 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Update template parameter alignments for 10 language pairs

https://gerrit.wikimedia.org/r/805366

gerritbot added a comment.Jun 14 2022, 12:20 PM

Change 805370 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] testwiki: Enable SectionTranslation for 11 Wikipedias

https://gerrit.wikimedia.org/r/805370

gerritbot added a comment.Jun 15 2022, 7:49 AM

Change 805726 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2022-06-15-074244-production

https://gerrit.wikimedia.org/r/805726

gerritbot added a comment.Jun 15 2022, 12:14 PM

Change 805726 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2022-06-15-074244-production

https://gerrit.wikimedia.org/r/805726

Stashbot mentioned this in T310116: Enable Section Translation in Uzbek Wikipedia.Jun 15 2022, 12:25 PM

Mentioned in SAL (#wikimedia-operations) [2022-06-15T12:25:39Z] <kart_> Updated cxserver to 2022-06-15-074244-production (T309266, T310116, T309384, T306963)

Stashbot mentioned this in T306963: Integrate new section mapping database.Jun 15 2022, 12:25 PM
Stashbot mentioned this in T309266: Adjust default MT services for pairs where the default is not the most used.
gerritbot added a comment.Jun 16 2022, 7:08 AM

Change 805370 merged by jenkins-bot:

[operations/mediawiki-config@master] testwiki: Enable SectionTranslation for 11 Wikipedias

https://gerrit.wikimedia.org/r/805370

Stashbot added a comment.Jun 16 2022, 7:22 AM

Mentioned in SAL (#wikimedia-operations) [2022-06-16T07:22:24Z] <kartik@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:805370|testwiki: Enable SectionTranslation for 11 Wikipedias (T309384 T310116)]] (duration: 03m 41s)

KartikMistry updated the task description. (Show Details)Jun 16 2022, 7:34 AM
KartikMistry added a subscriber: UOzurumba.

@UOzurumba We are good to go with the 'Communicate with the communities' step.

Pginer-WMF reassigned this task from KartikMistry to UOzurumba.Jun 27 2022, 12:40 PM
Pginer-WMF added a subscriber: KartikMistry.
UOzurumba added a project: MoveComms-Support (Apr-Jun-2022).Jun 28 2022, 12:53 AM
UOzurumba updated the task description. (Show Details)Jun 29 2022, 12:48 PM
UOzurumba updated the task description. (Show Details)Jun 29 2022, 1:12 PM
UOzurumba updated the task description. (Show Details)Jun 29 2022, 5:03 PM
UOzurumba updated the task description. (Show Details)Jun 29 2022, 6:11 PM
Pginer-WMF edited projects, added Language-Team (Language-2022-July-September); removed Language-Team (Language-2022-April-June).Jul 4 2022, 10:56 AM
Pginer-WMF moved this task from Quarter Backlog to In Progress on the Language-Team (Language-2022-July-September) board.
UOzurumba edited projects, added MoveComms-Support (Jul-Sep-2022); removed MoveComms-Support (Apr-Jun-2022).Jul 13 2022, 12:17 AM
UOzurumba updated the task description. (Show Details)Jul 13 2022, 1:38 PM
UOzurumba added a comment.Jul 13 2022, 1:43 PM

Hello @KartikMistry, the communication with the communities are complete. Please, do not deploy to Cantonese Wikipedia yet, a user complained about the quality of translation. Thank you!

UOzurumba updated the task description. (Show Details)Jul 13 2022, 1:53 PM
Pginer-WMF updated the task description. (Show Details)Jul 14 2022, 7:58 AM
Pginer-WMF updated the task description. (Show Details)
Pginer-WMF merged a task: T304866: Enable Content and Section Translation for Central Kurdish Wikipedia.
Pginer-WMF reassigned this task from UOzurumba to KartikMistry.Jul 14 2022, 8:01 AM

Ok, we can consider Cantonese for later using a separate ticket (T304865), and proceed with enabling the rest.

Pginer-WMF updated the task description. (Show Details)Jul 14 2022, 8:01 AM
KartikMistry updated the task description. (Show Details)Jul 15 2022, 6:19 AM
gerritbot added a comment.Jul 15 2022, 6:30 AM

Change 814015 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] Enable Content and Section translation on WPs with NLLB-200 MT support

https://gerrit.wikimedia.org/r/814015

KartikMistry moved this task from In Progress to In Review on the Language-Team (Language-2022-July-September) board.Jul 15 2022, 6:31 AM
gerritbot added a comment.Jul 18 2022, 7:02 AM

Change 814015 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable Content and Section translation on WPs with NLLB-200 MT support

https://gerrit.wikimedia.org/r/814015

Stashbot added a comment.Jul 18 2022, 7:10 AM

Mentioned in SAL (#wikimedia-operations) [2022-07-18T07:10:55Z] <kartik@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:814015|Enable Content and Section translation on WPs with NLLB-200 MT support (T309384)]] (duration: 02m 53s)

KartikMistry updated the task description. (Show Details)Jul 18 2022, 7:25 AM
gerritbot added a comment.Jul 18 2022, 7:26 AM

Change 814706 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] Enable ContentTranslation out of Beta for ay, ilo, kg, ln, nso, and tn Wikipedias

https://gerrit.wikimedia.org/r/814706

gerritbot added a comment.Jul 18 2022, 7:33 AM

Change 814706 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable ContentTranslation out of Beta for ay, ilo, kg, ln, nso, and tn Wikipedias

https://gerrit.wikimedia.org/r/814706

Stashbot added a comment.Jul 18 2022, 7:40 AM

Mentioned in SAL (#wikimedia-operations) [2022-07-18T07:40:24Z] <kartik@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:814706|Enable ContentTranslation out of Beta for ay, ilo, kg, ln, nso, and tn Wikipedias (T309384)]] (duration: 02m 51s)

KartikMistry updated the task description. (Show Details)Jul 18 2022, 7:41 AM
KartikMistry moved this task from In Review to Done on the Language-Team (Language-2022-July-September) board.Jul 18 2022, 7:47 AM
KartikMistry updated the task description. (Show Details)Jul 19 2022, 12:09 PM
gerritbot added a comment.Jul 19 2022, 12:10 PM

Change 815251 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] Enable ContentTranslation out of Beta for sswiki

https://gerrit.wikimedia.org/r/815251

KartikMistry moved this task from Done to In Review on the Language-Team (Language-2022-July-September) board.Jul 19 2022, 12:31 PM
gerritbot added a comment.Jul 20 2022, 7:07 AM

Change 815251 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable ContentTranslation out of Beta for sswiki

https://gerrit.wikimedia.org/r/815251

Stashbot added a comment.Jul 20 2022, 7:14 AM

Mentioned in SAL (#wikimedia-operations) [2022-07-20T07:14:53Z] <kartik@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:815251|Enable ContentTranslation out of Beta for sswiki (T309384)]] (duration: 03m 24s)

KartikMistry updated the task description. (Show Details)Jul 20 2022, 7:16 AM
KartikMistry moved this task from In Review to Done on the Language-Team (Language-2022-July-September) board.
Pginer-WMF closed this task as Resolved.Jul 20 2022, 8:31 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits