Page MenuHomePhabricator
Create Task
Maniphest T205700

Apertium fails to translate a quote template
Closed, ResolvedPublic
Actions

Description

Translating en:Užican_dialect to Spanish. Under "History" section, there is one quote that starts with "The Turkish influence...".

Trying to translate that quote silently fails and empty section is added instead, while using Apertium.

Details

SubjectRepoBranchLines +/-
Do not pass blank textblocks to machine translation servicesmediawiki/services/cxservermaster+8 -1
Customize query in gerrit

Related Objects

Event Timeline

• santhosh created this task.Sep 28 2018, 11:23 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 28 2018, 11:23 AM
• santhosh triaged this task as Medium priority.Sep 28 2018, 11:24 AM
• santhosh edited projects, added CX-cxserver; removed ContentTranslation.
gerritbot subscribed.Sep 28 2018, 11:26 AM

Change 463454 had a related patch set uploaded (by Santhosh; owner: Santhosh):
[mediawiki/services/cxserver@master] Do not pass blank textblocks to machine translation services

https://gerrit.wikimedia.org/r/463454

gerritbot added a project: Patch-For-Review.Sep 28 2018, 11:26 AM
• Petar.petkovic moved this task from Backlog to Parsing and annotation on the CX-cxserver board.Sep 28 2018, 12:07 PM
• Petar.petkovic moved this task from Backlog to In Review on the Language-2018-July-September board.
• Petar.petkovic subscribed.Sep 28 2018, 5:36 PM

Before the patch, trying to translate the quote resulted in empty section. With the patch, template is adapted, although author is not mapped well: you can see "24px24px" being used in the author field.
As far as the main piece of text goes, the source is applied, not translated via Apertium.

cx2-quote-template-apertium.png (317×795 px, 18 KB)

• santhosh added a comment.EditedOct 1 2018, 4:51 AM

No plans to translate the content of template params. We don't do it for any templates.

Parameter mapping depends so many details. And not 100% guranteed. In this case the template params are numbered params and order differs in source and target language. This will require editor intervention.

image.png (494×788 px, 24 KB)

Pginer-WMF edited projects, added Language-2018-Oct-December; removed Language-2018-July-September.Oct 1 2018, 3:57 PM
Pginer-WMF moved this task from Backlog to In Review on the Language-2018-Oct-December board.
gerritbot added a comment.Oct 3 2018, 11:29 AM

Change 463454 merged by jenkins-bot:
[mediawiki/services/cxserver@master] Do not pass blank textblocks to machine translation services

https://gerrit.wikimedia.org/r/463454

• Petar.petkovic removed a project: Patch-For-Review.Oct 3 2018, 11:30 AM
• Petar.petkovic moved this task from In Review to QA on the Language-2018-Oct-December board.
• Petar.petkovic removed a subscriber: gerritbot.
KartikMistry subscribed.Oct 4 2018, 3:04 PM

Waiting for cxserver deployment.

Arrbee edited projects, added Language-Team (Language-2018-October-December); removed Language-2018-Oct-December.Oct 4 2018, 4:51 PM
Arrbee moved this task from Backlog to QA on the Language-Team (Language-2018-October-December) board.
Etonkovidova subscribed.Oct 11 2018, 12:08 AM

@KartikMistry - has cxserver been deployed? The issue is still present in testwiki (wmf.24) although Apertium handles the translation as per @Petar.petkovic comment's screenshot. The translation of quote template still silently fails in cx2 (both for Apertium and Yandex(of course)).

Stashbot mentioned this in T205420: CXServer fails with HTTP 500: "MT processing error: undefined".Oct 15 2018, 3:14 AM
Stashbot mentioned this in T203077: Performance analysis for translate API.
Stashbot subscribed.

Mentioned in SAL (#wikimedia-operations) [2018-10-15T03:14:02Z] <kartik@deploy1001> Started deploy [cxserver/deploy@5a70ef1]: Update cxserver to 47a864b (T205420, T203077, T205700, T205616)

Stashbot mentioned this in T205616: CX2: Section alignment broken when translating "Fleming: The Man Who Would Be Bond" from Hebrew.Oct 15 2018, 3:14 AM
Stashbot added a comment.Oct 15 2018, 3:18 AM

Mentioned in SAL (#wikimedia-operations) [2018-10-15T03:18:46Z] <kartik@deploy1001> Finished deploy [cxserver/deploy@5a70ef1]: Update cxserver to 47a864b (T205420, T203077, T205700, T205616) (duration: 04m 44s)

KartikMistry added a comment.Oct 16 2018, 7:35 AM

Verified. It doesn't silently fail now.

KartikMistry moved this task from QA to Done on the Language-Team (Language-2018-October-December) board.Oct 16 2018, 7:35 AM
Etonkovidova moved this task from Done to Priority backlog on the Language-Team (Language-2018-October-December) board.Oct 21 2018, 10:13 PM

Re-checked in wmf.26 - Apertium doesn't silently fails, but doesn't translate the quote template either:

Screen Shot 2018-10-21 at 3.09.32 PM.png (592×1 px, 190 KB)

Since the title of this task was about actually translating the content of the quote template - "Apertium fails to translate a quote template" - I'm moving the task back to Priority Backlog.

Pginer-WMF moved this task from Priority backlog to Backlog on the Language-Team (Language-2018-October-December) board.Oct 22 2018, 7:02 AM
Pginer-WMF subscribed.
In T205700#4684379, @Etonkovidova wrote:

Since the title of this task was about actually translating the content of the quote template - "Apertium fails to translate a quote template" - I'm moving the task back to Priority Backlog.

Moving to general backlog since it was not in priority backlog before.

• Petar.petkovic moved this task from Backlog to QA on the Language-Team (Language-2018-October-December) board.Oct 22 2018, 7:16 AM
In T205700#4628388, @santhosh wrote:

No plans to translate the content of template params. We don't do it for any templates.

Moving back to QA, because the reason the ticket got moved to Backlog is the template params not being translated.

Etonkovidova closed this task as Resolved.Oct 24 2018, 11:45 PM

@Petar.petkovic translating quote template in cx2 strangely regressed Apertium silently failing.

In production (wmf.26)

  • the quote is displayed in English as before (see the screenshot in my comment above)
  • a user is correctly informed that "Template unavailable"

Given the current behavior for translating quote template in production in production and @santhosh comment

No plans to translate the content of template params. We don't do it for any templates.

I am closing the issue as resolved.

Nikerabbit moved this task from QA to Done on the Language-Team (Language-2018-October-December) board.Oct 25 2018, 7:10 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL