Adjust Norwegian mapping for MinT configuration
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Pginer-WMF
	Jun 1 2023, 8:12 AM

Description

Language codes are used to identify languages for Wikipedia and for the translation models used in MinT. Since there are different standards for language codes (using 2 or 3 letters) and exceptional cases, some adjustments in the mappings were needed (T336525). This ticket covers the particular case of Norwegian.
The Norwegian Bokmål Wikipedia lives on no.wikipedia.org for historical reasons, but its content language is nb.

To reflect this in MinT, the following changes are needed:

Mapping from Wikipedia codes to NLLB-200 codes. In this file the "nb": "nob_Latn" line should be replaced by "no": "nob_Latn"
List of supported languages. In this file the - nb item should be replaced by - no.

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Update MinT to 2023-06-06-120533-production	operations/deployment-charts	master	+1 -1
	Adjust Norwegian mapping for MinT configuration	mediawiki/services/machinetranslation	master	+2 -2

Customize query in gerrit

Related Objects

Mentioned In: T337686: Issues with apostrophes when translating with MinT
T337708: MinT translates en dash to ??
Mentioned Here: T337686: Issues with apostrophes when translating with MinT
T337708: MinT translates en dash to ??
T338146: Enable MinT for some languages with potential issues with current translation services
T336525: Review code mappings for MinT

Event Timeline

Pginer-WMF created this task.Jun 1 2023, 8:12 AM

Restricted Application added subscribers: jhsoby, Aklapper. · View Herald TranscriptJun 1 2023, 8:12 AM

Pginer-WMF triaged this task as Medium priority.Jun 1 2023, 8:12 AM

Pginer-WMF added a project: Language-Team (Language-2023-April-June).

KartikMistry moved this task from Backlog to Product integration on the MinT board.Jun 1 2023, 8:27 AM

KartikMistry claimed this task.Jun 1 2023, 11:21 AM

Change 925759 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[mediawiki/services/machinetranslation@master] Adjust Norwegian mapping for MinT configuration

https://gerrit.wikimedia.org/r/925759

gerritbot added a project: Patch-For-Review.Jun 1 2023, 12:11 PM

KartikMistry moved this task from Quarter Backlog to In Review on the Language-Team (Language-2023-April-June) board.Jun 1 2023, 12:11 PM

Have you tested that this change works as intended? The domain name for the Norwegian Bokmål Wikipedia is no.wikipedia.org and the database name is nowiki, while the content language is set to nb. If the tool uses the domain name, this change would work, but if it uses the content language I fear it might break.

jhsoby updated the task description. (Show Details)Jun 1 2023, 12:27 PM

Change 925759 merged by jenkins-bot:

[mediawiki/services/machinetranslation@master] Adjust Norwegian mapping for MinT configuration

https://gerrit.wikimedia.org/r/925759

Maintenance_bot removed a project: Patch-For-Review.Jun 6 2023, 12:11 PM

Change 927160 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update MinT to 2023-06-06-120533-production

https://gerrit.wikimedia.org/r/927160

gerritbot added a project: Patch-For-Review.Jun 6 2023, 12:14 PM

KartikMistry moved this task from In Review to Check after deployment on the Language-Team (Language-2023-April-June) board.Jun 6 2023, 12:15 PM

In T337910#8895213, @jhsoby wrote:

Have you tested that this change works as intended? The domain name for the Norwegian Bokmål Wikipedia is no.wikipedia.org and the database name is nowiki, while the content language is set to nb. If the tool uses the domain name, this change would work, but if it uses the content language I fear it might break.

I included Norwegian for one of the upcoming iterations of enablements (T338146) with special attention to verify things work as expected.

Excellent! Then I trust all is good.

Change 927160 merged by jenkins-bot:

[operations/deployment-charts@master] Update MinT to 2023-06-06-120533-production

https://gerrit.wikimedia.org/r/927160

Mentioned in SAL (#wikimedia-operations) [2023-06-07T05:02:51Z] <kart_> Updated MinT to 2023-06-06-120533-production (T337910, T337686, T337708)