MT stops translating "randomly"
Closed, DeclinedPublic
Actions

Assigned To

Authored By

	• Jpita
	Aug 9 2019, 12:46 PM

Description

Steps to reproduce:

Start translating en:Tensor_product
Using Google as the MT engine, start translating one by one from the top of the article
As seen in the screenshot, the third section does not get translated. This happens again if you continue translating.

An error appears on the console although I'm not sure it is related

Method where this happens:

mw.cx.TranslationTracker.prototype.isExcludedFromValidation = function ( sectionModel ) {
    var excludedTypes = [
        'cxBlockImage', 'mwBlockImage',
        'cxTransclusionBlock', 'mwTransclusionBlock',
        'mwReferencesList',
        'mwMath',
        'definitionList',
        'mwAlienBlockExtension',
        'mwTable', 'list', 'mwHeading'
    ],
    childType = sectionModel.getChildNodeName();

    return excludedTypes.indexOf( childType ) >= 0;
};

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Update cxserver to 2019-12-05-090549-production	operations/deployment-charts	master	+3 -3
	TextBlock#getRootItem: Consider non-whitespace text	mediawiki/services/cxserver	master	+41 -0

Customize query in gerrit

Related Objects

Mentioned In: T217585: CX2: ISBN doubled, one correctly formatted with {{ISBN}}, another incorrectly formatted with [[Special:BookSources]]
rDEPLOYCHARTS9227a7e5e15a: Update cxserver to 2019-12-05-090549-production
T174276: After sometimes the translator is blocked, user must refresh the page
T230200: Whole article as one section
T214256: CX2 shows </img> instead of math formulas
Mentioned Here: T217585: CX2: ISBN doubled, one correctly formatted with {{ISBN}}, another incorrectly formatted with [[Special:BookSources]]

Event Timeline

• Jpita created this task.Aug 9 2019, 12:46 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 9 2019, 12:46 PM

• Jpita updated the task description. (Show Details)Aug 9 2019, 12:47 PM

• Jpita mentioned this in T214256: CX2 shows </img> instead of math formulas.

• Petar.petkovic renamed this task from MT stops translating "randomly". to MT stops translating "randomly".Aug 9 2019, 12:54 PM

• Petar.petkovic updated the task description. (Show Details)

Pginer-WMF triaged this task as Medium priority.Aug 26 2019, 3:15 PM

Pginer-WMF moved this task from Backlog to Priority backlog on the Language-Team (Language-2019-July-September) board.

Unhandled Javascript exception was failing on call to getChildNodeName() in mw.cx.TranslationTracker#isExcludedFromValidation. That method is rewritten in 529727 and should no longer happen once the patch is merged.

When I was using Content Translation (as a user) to translate articles to Serbian, I've seen MT quality decline rapidly as I was adding more sections to the translation. It got to the point where it stopped translating, just what this ticket is about. I don't think article included any math like example from description.

MT engine was Google Translate and source language was Croatian, if I remember correctly. Now, translating from Croatian to Serbian is pretty easy, you swap Latin script to Cyrillic (you don't have to as Serbian can be written in both Latin and Cyrillic) and change some words, but that doesn't matter to MT engines. At times, it's clear that translation from Croatian to Serbian goes through English.
Not sure if MT engine is to blame or our internal code using it, for this stopping of translation.

declining quality can only be attributed to MT service. It is either translated or not translated from cxserver perspective. How good the translation is always with MT service. But let us watch this ticket after https://gerrit.wikimedia.org/r/529727 is merged

• Petar.petkovic mentioned this in T230200: Whole article as one section.Aug 28 2019, 11:12 AM

Pginer-WMF edited projects, added Language-Team (Language-2019-October-December); removed Language-Team (Language-2019-July-September).Oct 9 2019, 11:55 AM

Pginer-WMF moved this task from Backlog to Priority backlog on the Language-Team (Language-2019-October-December) board.

Pginer-WMF moved this task from Priority backlog to Maintenance backlog on the Language-Team (Language-2019-October-December) board.Oct 9 2019, 2:14 PM

santhosh claimed this task.Nov 6 2019, 6:54 AM

santhosh moved this task from Maintenance backlog to In Progress on the Language-Team (Language-2019-October-December) board.

Change 548956 had a related patch set uploaded (by Santhosh; owner: Santhosh):
[mediawiki/services/cxserver@master] TextBlock#getRootItem: Consider non-whitespace text

https://gerrit.wikimedia.org/r/548956

gerritbot added a project: Patch-For-Review.Nov 6 2019, 7:29 AM

santhosh moved this task from In Progress to In Review on the Language-Team (Language-2019-October-December) board.Nov 6 2019, 8:00 AM

Pginer-WMF mentioned this in T174276: After sometimes the translator is blocked, user must refresh the page.Nov 11 2019, 9:12 AM

Are there any articles where this behavior is reproducible? I tried (locally) en:Tensor_product, which is mentioned in the description, but it works fine (using Google and Yandex), without 548956.

@santhosh and @Jpita, any examples?

@Petar.petkovic I no longer see it happening in production

• Jpita closed this task as Declined.Nov 19 2019, 8:51 PM

• Jpita moved this task from In Review to Done on the Language-Team (Language-2019-October-December) board.

Change 548956 merged by jenkins-bot:
[mediawiki/services/cxserver@master] TextBlock#getRootItem: Consider non-whitespace text

https://gerrit.wikimedia.org/r/548956

Maintenance_bot removed a project: Patch-For-Review.Nov 20 2019, 12:11 PM

Change 555784 had a related patch set uploaded (by KartikMistry; owner: KartikMistry):
[operations/deployment-charts@master] Update cxserver to 2019-12-05-090549-production

https://gerrit.wikimedia.org/r/555784

gerritbot added a project: Patch-For-Review.Dec 9 2019, 7:48 AM

Change 555784 merged by jenkins-bot:
[operations/deployment-charts@master] Update cxserver to 2019-12-05-090549-production

https://gerrit.wikimedia.org/r/555784

KartikMistry mentioned this in rDEPLOYCHARTS9227a7e5e15a: Update cxserver to 2019-12-05-090549-production.Dec 9 2019, 8:39 AM

Mentioned in SAL (#wikimedia-operations) [2019-12-09T08:49:19Z] <kart_> Updated cxserver to 2019-12-05-090549-production (T217585, T230195)