Integrate Elia (formerly itzultzailea) MT system
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Arrbee
	Jun 12 2020, 5:04 AM

Description

Elia is an MT system replacing Matxin:

API: https://mt-api.elhuyar.eus/
Supported languages: Basque, Spanish, Catalan, Galician, French, and English

This ticket proposes to integrate Elia in Content Translation. As a result, the option to "Use Elia" will be available in the list of MT services for the languages where it is supported:

Screenshot 2021-04-27 at 10.57.44 2.png (344×727 px, 81 KB)

Deploy new key in Production (T284887) (SRE + @KartikMistry)
Enable Elia in Content Translation: https://gerrit.wikimedia.org/r/c/mediawiki/services/cxserver/+/697702
Enable Elia in cxserver: https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/699089 (@KartikMistry)
Remove Matxin support: https://phabricator.wikimedia.org/T285199
Update the documentation.

We received a request from Galder González, member of the (Basque Wikimedians User Group) through the Elhuyar Foundation to consider the neural machine translation system - itzultzailea for integration with CX.

Details

	Subject	Repo	Branch	Lines +/-
	Add support for Elia MT to cxserver	operations/deployment-charts	master	+12 -2
	Add Elia MT service	mediawiki/services/cxserver	master	+138 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T76456 Language Engineering tracker of trackers (tracking)
Open	None	T76454 [Epic] ContentTranslation - MT support
Open	None	T86700 Add more machine translation services (tracking)
Resolved	santhosh	T255231 Integrate Elia (formerly itzultzailea) MT system
Resolved	Volans	T284887 Deploy Elia MT secrets in Production for ContentTranslation
Resolved	KartikMistry	T285199 Remove Matxin support from ContentTranslation

Event Timeline

Arrbee triaged this task as Medium priority.Jun 12 2020, 5:04 AM

Arrbee created this task.

Amaiaj subscribed.Jun 12 2020, 7:34 AM

Pginer-WMF added a project: Language-Team (Language-2020-October-December).Oct 9 2020, 8:33 AM

My understanding is that Itzultzailea MT is a replacement of Matxin, but it would be good to clarify the license aspect.

Is Itzultzailea MT using an open source license? I could not find the code or a reference to the license.

Yes, Itzultzailea MT is a replacement of Matxin.
But it's not using an open source license. Itzultzailea MT uses an open source neural machine translation system for trainning but it can be used only by licenced users.

Pginer-WMF edited projects, added Language-Team (Language-2021-January-March); removed Language-Team (Language-2020-October-December).Jan 4 2021, 1:20 PM

Pginer-WMF edited projects, added Language-Team (Language-2021-April-June); removed Language-Team (Language-2021-January-March).Apr 1 2021, 4:16 PM

Pginer-WMF moved this task from Needs Triage to MT on the ContentTranslation board.Apr 27 2021, 8:50 AM

Pginer-WMF renamed this task from Evaluate itzultzailea MT system to Integrate Elia (formerly itzultzailea) MT system.Apr 27 2021, 9:50 AM

Pginer-WMF updated the task description. (Show Details)

Pginer-WMF moved this task from Quarter Backlog to Priority Backlog on the Language-Team (Language-2021-April-June) board.Apr 30 2021, 10:00 AM

Pginer-WMF raised the priority of this task from Medium to High.Jun 1 2021, 8:52 AM

santhosh claimed this task.Jun 2 2021, 5:24 AM

santhosh moved this task from Priority Backlog to In Progress on the Language-Team (Language-2021-April-June) board.

Change 697702 had a related patch set uploaded (by Santhosh; author: Santhosh):

[mediawiki/services/cxserver@master] Add Elia MT service

https://gerrit.wikimedia.org/r/697702