Page MenuHomePhabricator
Create Task
Maniphest T337290

Enable MinT, Content and Section Translation for 10 languages previously lacking machine translation
Closed, ResolvedPublic
Actions

Description

As machine translation becomes available in more languages with MinT and NLLB-200 models, we want to expose the improved translation tools more broadly to facilitate the creation of content for those communities.

This ticket selects an initial set of languages that had no machine translation services available before. This ticket proposes to enable machine transition using MinT, set Content Translation as a default tool and enable the mobile experience with Section Translation.

As part of this process, we'll generate the template parameter alignments (T221211) for these languages, enable access to the tool in test wiki, and communicate with the different communities to inform them about the changes.

These are the languages selected for this task:

  1. Kashmiri (ks/kas_Arab) ( view request and T326541 )
  2. Santali (sat/sat_Olck) ( view request)
  3. Tumbuka (tum/tum_Latn) (view request)
  4. Fulah/Nigerian Fulfulde (ff/fuv_Latn)
  5. Kabyle (kab/kab_Latn)
  6. Balinese (ban/ban_Latn)
  7. Banjar (bjn/bjn_Latn)
  8. South Azerbaijani (azb/azb_Arab)
  9. Pangasinan (pag/pag_Latn)
  10. Tibetan (bo/bod_Tibt)

Steps:

  • Enable MinT for the selected languages.
  • Enable Section Translation on selected wikis on Test Wikipedia
  • Enable Content Translation as default in the selected Wikipedias
  • Enable Section Translation in the selected Wikipedias

Next group of languages to enable: T337669: Enable MinT, Content and Section Translation for a 2nd group of 10 languages previously lacking machine translation

Details

SubjectRepoBranchLines +/-
Enable Content and Section Translation for 9 Wikipediaoperations/mediawiki-configmaster+11 -11
Update cxserver to 2023-06-07-044025-productionoperations/deployment-chartsmaster+1 -1
Add template parameter alignments for 17 language pairsmediawiki/services/cxservermaster+0 -0
testwiki: Enable Section Translation for 9 Wikipediaoperations/mediawiki-configmaster+1 -1
Update cxserver to 2023-05-24-115506-productionoperations/deployment-chartsmaster+1 -1
Update cxserver to 2023-05-24-115506-productionoperations/deployment-chartsmaster+1 -1
Enable MinT for 10 languages previously lacking machine translationmediawiki/services/cxservermaster+25 -53
Customize query in gerrit

Related Objects
Search...

Event Timeline

Pginer-WMF triaged this task as Medium priority.May 23 2023, 9:12 AM
Pginer-WMF created this task.
Pginer-WMF added a parent task: T330066: Enable Content and Section translation on Wikipedias for languages to be supported by NLLB in the future.
Pginer-WMF mentioned this in T326578: Enable NLLB-200 for languages lacking other Machine Translation options.May 23 2023, 9:15 AM
Pginer-WMF mentioned this in T330066: Enable Content and Section translation on Wikipedias for languages to be supported by NLLB in the future.May 23 2023, 9:18 AM
gerritbot added a comment.May 24 2023, 8:43 AM

Change 922796 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/cxserver@master] Enable MinT for 10 languages previously lacking machine translation

https://gerrit.wikimedia.org/r/922796

gerritbot added a project: Patch-For-Review.May 24 2023, 8:43 AM
KartikMistry moved this task from Quarter Backlog to In Review on the Language-Team (Language-2023-April-June) board.May 24 2023, 8:43 AM
Pginer-WMF moved this task from Backlog to Adding languages on the MinT board.May 24 2023, 10:29 AM
gerritbot added a comment.May 24 2023, 11:27 AM

Change 922796 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Enable MinT for 10 languages previously lacking machine translation

https://gerrit.wikimedia.org/r/922796

Maintenance_bot removed a project: Patch-For-Review.May 24 2023, 11:30 AM
gerritbot added a comment.May 24 2023, 12:00 PM

Change 922826 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2023-05-24-115506-production

https://gerrit.wikimedia.org/r/922826

gerritbot added a project: Patch-For-Review.May 24 2023, 12:00 PM
gerritbot added a comment.May 25 2023, 5:23 AM

Change 922826 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2023-05-24-115506-production

https://gerrit.wikimedia.org/r/922826

gerritbot added a comment.May 25 2023, 5:29 AM

Change 922959 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2023-05-24-115506-production

https://gerrit.wikimedia.org/r/922959

gerritbot added a comment.May 25 2023, 5:34 AM

Change 922959 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2023-05-24-115506-production

https://gerrit.wikimedia.org/r/922959

KartikMistry updated the task description. (Show Details)May 25 2023, 6:05 AM
KartikMistry moved this task from In Review to In Progress on the Language-Team (Language-2023-April-June) board.
Maintenance_bot removed a project: Patch-For-Review.May 25 2023, 6:10 AM
Pginer-WMF updated the task description. (Show Details)May 26 2023, 10:31 AM
Pginer-WMF updated the task description. (Show Details)May 26 2023, 10:34 AM
Iflaq awarded a token.May 28 2023, 7:33 PM
gerritbot added a comment.May 29 2023, 8:45 AM

Change 924050 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] testwiki: Enable Section Translation for 9 Wikipedia

https://gerrit.wikimedia.org/r/924050

gerritbot added a project: Patch-For-Review.May 29 2023, 8:45 AM
Pginer-WMF mentioned this in T337669: Enable MinT, Content and Section Translation for a 2nd group of 10 languages previously lacking machine translation.May 29 2023, 9:00 AM
Pginer-WMF updated the task description. (Show Details)May 29 2023, 9:09 AM
gerritbot added a comment.May 30 2023, 7:19 AM

Change 924050 merged by jenkins-bot:

[operations/mediawiki-config@master] testwiki: Enable Section Translation for 9 Wikipedia

https://gerrit.wikimedia.org/r/924050

Stashbot added a comment.May 30 2023, 7:19 AM

Mentioned in SAL (#wikimedia-operations) [2023-05-30T07:19:37Z] <kartik@deploy1002> Started scap: Backport for [[gerrit:924050|testwiki: Enable Section Translation for 9 Wikipedia (T337290)]]

Stashbot added a comment.May 30 2023, 7:21 AM

Mentioned in SAL (#wikimedia-operations) [2023-05-30T07:21:08Z] <kartik@deploy1002> kartik: Backport for [[gerrit:924050|testwiki: Enable Section Translation for 9 Wikipedia (T337290)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet

Stashbot added a comment.May 30 2023, 7:29 AM

Mentioned in SAL (#wikimedia-operations) [2023-05-30T07:29:16Z] <kartik@deploy1002> Finished scap: Backport for [[gerrit:924050|testwiki: Enable Section Translation for 9 Wikipedia (T337290)]] (duration: 09m 38s)

KartikMistry updated the task description. (Show Details)May 30 2023, 7:29 AM
Maintenance_bot removed a project: Patch-For-Review.May 30 2023, 7:30 AM
KartikMistry updated the task description. (Show Details)May 30 2023, 7:30 AM
gerritbot added a comment.May 30 2023, 1:35 PM

Change 924511 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/mediawiki-config@master] Enable Content and Section Translation for 9 Wikipedia

https://gerrit.wikimedia.org/r/924511

gerritbot added a project: Patch-For-Review.May 30 2023, 1:35 PM
Pginer-WMF updated the task description. (Show Details)May 31 2023, 10:32 AM
UOzurumba updated the task description. (Show Details)May 31 2023, 5:32 PM
UOzurumba updated the task description. (Show Details)May 31 2023, 5:42 PM
KartikMistry updated the task description. (Show Details)Jun 6 2023, 2:15 AM
KartikMistry added a comment.Jun 6 2023, 4:54 AM

Result of template parameter mapping:

sqlite> select count(*) from templates where source_lang='en' and target_lang='azb';
76
sqlite> select count(*) from templates where source_lang='en' and target_lang='bjn';
17
sqlite> select count(*) from templates where source_lang='en' and target_lang='bo';
3
sqlite> select count(*) from templates where source_lang='en' and target_lang='ff';
1
sqlite> select count(*) from templates where source_lang='en' and target_lang='kab';
15
sqlite> select count(*) from templates where source_lang='en' and target_lang='ks';
11
sqlite> select count(*) from templates where source_lang='en' and target_lang='pag';
7
sqlite> select count(*) from templates where source_lang='en' and target_lang='tum';
4
sqlite> select count(*) from templates where source_lang='azb' and target_lang='en';
12
sqlite> select count(*) from templates where source_lang='bjn' and target_lang='en';
5
sqlite> select count(*) from templates where source_lang='bo' and target_lang='en';
0
sqlite> select count(*) from templates where source_lang='ff' and target_lang='en';
1
sqlite> select count(*) from templates where source_lang='kab' and target_lang='en';
1
sqlite> select count(*) from templates where source_lang='ks' and target_lang='en';
4
sqlite> select count(*) from templates where source_lang='pag' and target_lang='en';
0
sqlite> select count(*) from templates where source_lang='tum' and target_lang='en';
1
gerritbot added a comment.Jun 6 2023, 4:58 AM

Change 927325 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/cxserver@master] Add template parameter alignments for 17 language pairs

https://gerrit.wikimedia.org/r/927325

gerritbot added a comment.Jun 7 2023, 4:39 AM

Change 927325 merged by jenkins-bot:

[mediawiki/services/cxserver@master] Add template parameter alignments for 17 language pairs

https://gerrit.wikimedia.org/r/927325

gerritbot added a comment.Jun 7 2023, 4:48 AM

Change 927812 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update cxserver to 2023-06-07-044025-production

https://gerrit.wikimedia.org/r/927812

gerritbot added a comment.Jun 7 2023, 5:13 AM

Change 927812 merged by jenkins-bot:

[operations/deployment-charts@master] Update cxserver to 2023-06-07-044025-production

https://gerrit.wikimedia.org/r/927812

Stashbot mentioned this in T337834: Enable MinT, Content and Section Translation for a 3rd group of 10 languages previously lacking machine translation.Jun 7 2023, 5:28 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-07T05:28:33Z] <kart_> Updated cxserver to 2023-06-07-044025-production (T337290, T337669, T337834)

KartikMistry updated the task description. (Show Details)Jun 7 2023, 5:30 AM
UOzurumba updated the task description. (Show Details)Jun 8 2023, 4:41 AM
gerritbot added a comment.Jun 8 2023, 7:03 AM

Change 924511 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable Content and Section Translation for 9 Wikipedia

https://gerrit.wikimedia.org/r/924511

Stashbot added a comment.Jun 8 2023, 7:04 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-08T07:04:30Z] <kartik@deploy1002> Started scap: Backport for [[gerrit:924511|Enable Content and Section Translation for 9 Wikipedia (T337290)]]

Stashbot added a comment.Jun 8 2023, 7:06 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-08T07:06:01Z] <kartik@deploy1002> kartik: Backport for [[gerrit:924511|Enable Content and Section Translation for 9 Wikipedia (T337290)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet

Maintenance_bot removed a project: Patch-For-Review.Jun 8 2023, 7:10 AM
Stashbot added a comment.Jun 8 2023, 7:14 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-08T07:14:23Z] <kartik@deploy1002> Finished scap: Backport for [[gerrit:924511|Enable Content and Section Translation for 9 Wikipedia (T337290)]] (duration: 09m 52s)

KartikMistry updated the task description. (Show Details)Jun 8 2023, 7:28 AM
KartikMistry moved this task from In Progress to Done on the Language-Team (Language-2023-April-June) board.Jun 8 2023, 7:42 AM
Pginer-WMF closed this task as Resolved.Jun 23 2023, 1:24 PM
JameelKaisar subscribed.Jun 29 2023, 6:09 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL