The [MADLAD-400 open source translation model](https://github.com/google-research/google-research/tree/master/madlad_400) supports many languages. Initial testing suggests quality may not be always very high, but can be still useful for those languages not supported by other services. Community input can help to identify when it is useful.
This ticket proposes to enable the MADLAD-400 model in the MinT test instance for communities to be able to try it. We selected Wikipedia languages which are not supported by any other translaiton service.
These are the languages selected:
!! (**In bold** languages with Content and Section translation enablement planned in T353510)!!
# **Arpitan** (frp)
- ~~**Romansh** (rm)~~ !!Community objected to MinT using MADLAD-400!!
- **Kabardian** (kbd)
- **Moksha** (mdf)
- **Gorontalo** (gor)
- **Avar** (av)
- **Komi-Permyak** (koi)
- ~~**Saterland Frisian** (stq)~~ !!Community objected to MinT using MADLAD-400!!
- **Chechen** (ce)
- ~~**Kalaallisut** (kl)~~ !!Community objected to MinT using MADLAD-400!!
- **Erzya** (myv)
- **Adyghe** (ady)
- **Newari** (new)
- ~~**Southern Altai** (alt)~~ !!Community objected to MinT using MADLAD-400!!
- **Kalmyk** (xal)
- **Jamaican Creole English** (jam)
- **Mon** (mnw)
- **Fiji Hindi** (hif)
- **Komi** (kv)
- **Tulu** (tcy)
- **Pampanga** (pam)
- **Tetum** (tet)
- **Karachay-Balkar** (krc)
- **Chamorro** (ch)
- **Gagauz** (gag)
- **Old English** (ang)
- ~~**Northern Sami** (se)~~ !!Community objected to MinT using MADLAD-400!!
- ~~**Navajo** (nv)~~ !!Community objected to MinT using MADLAD-400!!
- Aragonese (an) !!Apertium supports some pairs, MADLAD can provide support for other source languages!!
- Moroccan Arabic (ary) !!NLLB-200 is not providing the right variant according to T339926!!
- Bavarian (bar)
- Bislama (bi) !!OpusMT supports translations form English, MADLAD can provide support for other source languages!!
- ~~Breton (br)~~ !!Community objected to MinT using MADLAD-400!! !!Apertium supports some pairs, MADLAD can provide support for other source languages!!
- Cree (cr) !! `cr_Latn` code used by MADLAD-400!!!
- Manx (gv)
- ~~Ido (io)~~ !!Community objected to MinT using MADLAD-400!!
- Inuktitut (iu)
- ~~Kara-Kalpak (kaa)~~ !!Community objected to MinT using MADLAD-400!!
- ~~Cornish (kw)~~ !!Community objected to MinT using MADLAD-400!!
- ~~Madurese (mad)~~ !!Community objected to MinT using MADLAD-400!!
- Mirandese (mwl)
- Nan (nan) !!! `zh-min-nan` code used in Wikipedia. `nan_Latn_TW` code used by MADLAD-400!!!
- Low German (nds)
- Low Saxon (nds-nl) !!`nds_NL` code used by MADLAD-400!!!
- Nias (nia)
- Ossetic (os)
- ~~Serbo-Croatian (sh)~~ !!Community objected to MinT using MADLAD-400!!
- ~~Simple English (simple)~~ !!Community objected to MinT using MADLAD-400!!
- Saraiki (skr)
- Sranan Tongo (srn)
- ~~Talysh (tly)~~ !!Community objected to MinT using MADLAD-400!! !!`tly_IR` code used by MADLAD-400, but Wikipedia seems to use the latin script instead.!!
- Tuvinian (tyv)
- Venda (ve) !!OpusMT supports translations form English, MADLAD can provide support for other source languages!!
- ~~Walloon (wa)~~ !!Community objected to MinT using MADLAD-400!!
- Wu Chinese (wuu)
- ~~Cantonese (yue)~~ !!`zh-yue` code used in Wikipedia. As per T354666#9593836, MADLAD-400 has the same issues as other models not providing the right variant for the language ( T333835). !!
- **~~Zhuang** (za)~~ !!Not supported by MADLAD-400!!
Steps:
[x] Enable all selected languages in [the MinT test instance](https://translate.wmcloud.org/) (not for Content/Section translation)
[ ] Communicate with the communities. Inviting them to try MT quality asking whether the MT quality is useful to be available by default, as an option, or not at all.
- For languages where Content and Section Translation are not enabled by default yet, the communication can be combined as part of the plans to enable them (T353510). That is informing communities about both the enablement of Content Translation and the possibility of having MinT if the quality is good.
----- [] [[ https://io.wikipedia.org/wiki/Wikipedio:Portalo_di_la_komunitato#Enabling_machine_translation_support,_Section_and_Content_translation_tools_in_your_Wikipedia | Ido Wikipedia ]] (io)
- **Enable**: Content and Section Translation in Ido.
- **Don't enable** MADLAD-400 MT support. A member of the community tested it and indicated that the quality is poor, and the translation is out of context (adds made up words or phrases not included in the source article into the machine translation).
----- [x] [[ https://nds.wikipedia.org/wiki/Wikipedia:Ik_bruuk_H%C3%BClp#Enabling_machine_translation_support,_Section_and_Content_translation_tools_in_your_Wikipedia | Low German Wikipedia ]] (nds)
- Enable the Content and Section translation and MADLAD-400 in this Wiki; there was no response or objection to enabling it.
- [x] [[ https://nds-nl.wikipedia.org/wiki/Wikipedia:Praothoek#Enabling_machine_translation_support,_Section_and_Content_translation_tools_in_your_Wikipedia | Low Saxon Wikipedia ]](nds-nl)
- Enable the Content and Section translation and MADLAD-400 in this Wiki; there was no response or objection to enabling it.
- [x] [[ https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:Taberna#Enabling_machine_translation_support%2C_Section_and_Content_translation_tools_in_your_Wikipedia | Mirandese Wikipedia ]] (mwl)
- Enable the Content and Section translation and MADLAD-400 in this Wiki; there was no response or objection to enabling it.
----- [] [[ https://simple.wikipedia.org/wiki/Wikipedia:Simple_talk#Enabling_a_machine_translation_model,_Section_and_Content_translation_tools_in_your_Wikipedia | Simple English Wikipedia ]] (simple)
- The community **objected to enabling CX, SX and Machine translation** because of the content structure permitted in Simple English Wikipedia, which would derail the project.
----- [x] [[ https://zh-min-nan.wikipedia.org/wiki/Wikipedia:Chhi%C5%AB-%C3%A1-kha#Enabling_a_machine_translation_support_in_your_Wikipedia | Chinese (Min Nan) Wikipedia ]]
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [x] [[ https://an.wikipedia.org/wiki/Wikipedia:Tabierna/Noticias#Enabling_a_machine_translation_support_in_your_Wikipedia | Aragonese Wikipedia ]] (an)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [x] [[ https://tyv.wikipedia.org/wiki/%D0%92%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F:%D0%9D%D0%B8%D0%B8%D1%82%D0%B8%D0%BB%D0%B5%D0%BB_%D1%85%D0%B0%D0%B0%D0%BB%D0%B3%D0%B0%D0%B7%D1%8B#Enabling_a_machine_translation_support_in_your_Wikipedia | Tuvinian Wikipedia ]] (tyv)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [] [[ https://kw.wikipedia.org/wiki/Keskows_Wikipedia:Kanaseth#Enabling_a_machine_translation_support_in_your_Wikipedia | Cornish Wikipedia ]] (kw)
- The community feedback is that the translation quality is inferior. Someone rated it 3 on a scale of 1 to 10 when it comes to grammar and spelling, according to Cornish. It also adds some made-up phrases to the translation that are not in the source content. Therefore, the model **should not be enabled in their Wikipedia**.
----- [] [[ https://kaa.wikipedia.org/wiki/Wikipedia:J%C3%A1miyet_Portal%C4%B1#Enabling_a_machine_translation_support_in_your_Wikipedia | Kara-Kalpak Wikipedia ]] (kaa)
- **Do not enable the MADLAD-400 MT**. A member of the community indicated that the translation is not in Kara-Kalpak language; instead, the output is Uzbek.
----- [x]
[[https://cr.wikipedia.org/wiki/Wikipedia:Community_Portal#Enabling_a_machine_translation_support_in_your_Wikipedia | Cree Wikipedia]] (cr)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [x] [[ https://iu.wikipedia.org/wiki/%E1%90%85%E1%90%83%E1%91%AD%E1%90%B1%E1%91%8E%E1%90%8A:%E1%90%B9%E1%95%90%E1%93%82%E1%96%85#Enabling_a_machine_translation_support_in_your_Wikipedia | Inuktitut Wikipedia ]] (iu)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [x] [[ https://skr.wikipedia.org/wiki/%D9%88%DA%A9%DB%8C%D9%BE%DB%8C%DA%88%DB%8C%D8%A7:%D8%A8%D8%B1%D8%A7%D8%AF%D8%B1%DB%8C_%D8%AF%D8%A7_%D8%AF%DB%8C%D8%B1%DB%81 | Saraiki Wikipedia ]] (skr)
----- [] [[ https://wa.wikipedia.org/wiki/Wikipedia:C%C3%A5baret#Enabling_a_machine_translation_support_in_your_Wikipedia | Walloon Wikipedia ]] (wa)
- **Do not enable the MADLAD-400 MT**. A member of the community objected to having the machine translation because the translation model is not perfect and would give admins who are already stretched more work.
----- [x] [[ https://gv.wikipedia.org/wiki/Wikipedia:Ynnyd_y_phobble#Enabling_a_machine_translation_support_in_your_Wikipedia | Manx Wikipedia ]] (gv)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [x] [[ https://os.wikipedia.org/wiki/%D0%92%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8:%D0%9D%D1%8B%D1%85%D0%B0%D1%81#Enabling_a_machine_translation_support_in_your_Wikipedia | Ossetian/Ossetic Wikipedia ]] (os)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [] [[ https://sh.wikipedia.org/wiki/Wikipedija:Pijaca#Enabling_a_machine_translation_support_in_your_Wikipedia | Serbo-Croatian Wikipedia ]] (sh)
- **Do not enable it** a community member's feedback is that the translation quality is poor; It also adds some made-up phrases to the translation that are not in the source content.
----- [x] [[ https://wuu.wikipedia.org/wiki/Wikipedia:%E7%BA%A2%E8%8C%B6%E5%9D%8A#Enabling_a_machine_translation_support_in_your_Wikipedia | Wu Chinese Wikipedia ]] (wuu)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [x] [[ https://srn.wikipedia.org/wiki/Wikipedia:Kebroikiman_konmakandra#Enabling_a_machine_translation_support_in_your_Wikipedia | Sranan Tongo Wikipedia ]] (srn)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
- [] [[ https://mad.wikipedia.org/wiki/Wikip%C3%A8%E1%B8%8Dia:B%C3%A2rung_Kopi#Enabling_a_machine_translation_support_in_your_Wikipedia | Madurese Wikipedia ]] (mad)
- **Do not enable it** because a community member said that the translation in not accurate and the translation is in Indonesian language.
- [] [[ https://br.wikipedia.org/wiki/Wikipedia:Kumuniezh/An_davarn/sizhunvezh_15,_bloaz_2024#Enabling_a_machine_translation_support_in_your_Wikipedia | Breton ]] (br)
- **Do not enable it** a community member's feedback is that the translation quality is poor and not suitable as an aid.
- [] [[ https://tly.wikipedia.org/wiki/Vikipedi%C3%A1:Village_pump/Teknik#Enabling_a_machine_translation_support_in_your_Wikipedia | Talysh ]] (tly)
- **Do not enable it** a community member's feedback is that the translation quality is poor and uses Arabic script instead of latin.
----- [x] [[ https://bar.wikipedia.org/wiki/Wikipedia:Stammdisch#Enabling_a_machine_translation_support_in_your_Wikipedia | Bavarian ]] (bar)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
- [x] [[ https://bi.wikipedia.org/wiki/Wikipedia:Haus_blong_toktok#Enabling_a_machine_translation_support_in_your_Wikipedia | Bislama ]] (bi)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
----- [x] [[ https://ve.wikipedia.org/wiki/Wikipedia_talk:Community_Portal#Enabling_a_machine_translation_support_in_your_Wikipedia | Venda ]] (ve)
- Enable MADLAD-400 model in this Wiki; there was no response or objection to enabling it.
- [] [[ https://nia.wikipedia.org/wiki/Wikipedia:Monganga_afo_(baero)#Enabling_a_machine_translation_support_in_your_Wikipedia | Nias ]] (nia)
- **Do not enable it** a community member's feedback is that the translation quality is poor and adds made up words to the translation.
____
A set of additional languages for which there is no Wikipedia is supported by MADLAD-400: {T354675}