Page MenuHomePhabricator
Create Task
Maniphest T53731

After re-marking an updated page for translation, FuzzyBot does not react, or only ports over the previous update
Closed, ResolvedPublic
Actions

Description

NOTE: For a summary on related issues, patches and upgrade avenues, see T48716: Translation page does not contain the latest translations/last translation.

Example:

https://meta.wikimedia.org/w/index.php?title=Special%3ALog&type=pagetranslation&user=&page=Wikimedia+Highlights%2C+June+2013
https://meta.wikimedia.org/w/index.php?title=Wikimedia_Highlights,_June_2013/ml&action=history
https://meta.wikimedia.org/w/index.php?title=Wikimedia_Highlights,_June_2013&action=history

Consider the following three times the original page was re-marked for translation, each time incorporating a different change in the non-translateble part (which FuzzyBot should have ported over to the ml translation):

  • 18:15, 19 July 2013,
  • 18:29, 19 July 2013,
  • 00:48, 20 July 2013.

What happened was:

  • After the 18:15 update, FuzzyBot did not make any edits
  • After the 18:29 update, FuzzyBot edited the translated page to incorporate the 18:15 change
  • After the 00:48 update, FuzzyBot edited the translated page to incorporate the 18:29 change
  • The 00:48 update is still lacking in the translated page

See also

Details

Reference
bz51731
SubjectRepoBranchLines +/-
Add TranslationsUpdateJob to translate job runner groupoperations/puppetproduction+2 -2
Make sure MessageUpdateJobs are run before TranslateRenderJobs when markingmediawiki/extensions/Translatemaster+87 -47
Customize query in gerrit

Related Objects
Search...

Event Timeline

• bzimport raised the priority of this task from to High.Nov 22 2014, 1:53 AM
• bzimport added a project: MediaWiki-extensions-Translate.
• bzimport set Reference to bz51731.
• bzimport added a subscriber: Unknown Object (MLST).
• Tbayer created this task.Jul 20 2013, 3:01 AM
Nemo_bis added a comment.Oct 4 2013, 4:31 PM
  • Bug 54915 has been marked as a duplicate of this bug. ***
• Tbayer added a comment.Oct 12 2013, 12:09 AM

This is still happening, see e.g. https://meta.wikimedia.org/w/index.php?title=Wikimedia_Blog/Drafts/HTTPS_post/fr&diff=6018140&oldid=5712520

Nikerabbit added a comment.Oct 12 2013, 2:05 PM

And I still don't have environment for testing replication lag issues :(

• Tbayer added a comment.Apr 10 2014, 7:46 AM

This is still happening, causing non-English readers to see outdated versions of important pages:

https://meta.wikimedia.org/w/index.php?title=Grants:APG/Proposals/Community/Review&diff=prev&oldid=8117957
https://meta.wikimedia.org/w/index.php?title=Special:Log&page=Grants%3AAPG%2FProposals%2FCommunity%2FReview
https://meta.wikimedia.org/w/index.php?title=Grants:APG/Proposals/Community/Review/es&diff=8117971&oldid=6783758

Steinsplitter added a comment.May 2 2014, 5:26 PM

Can this be fixed please? Very very annoying bug. Causes many problems...

Nikerabbit added a comment.May 29 2014, 9:37 AM

I'm hoping that once we have time to setup the replication lag environment to usable state again, we will find clues how to fix this problem.

Nemo_bis awarded a token.Dec 12 2014, 8:25 AM
Nemo_bis added a comment.Jan 7 2015, 9:21 AM

Recent example: the update https://meta.wikimedia.org/w/index.php?title=Wikimedia_Suomi%2Ffi&action=historysubmit&diff=10905428&oldid=10852239 was only triggered after dummy edit https://meta.wikimedia.org/w/index.php?title=Wikimedia_Suomi&diff=prev&oldid=10905422 . See T48716#512614 for stats of how frequent this is.

Nikerabbit moved this task from Backlog to page translation on the MediaWiki-extensions-Translate board.Jan 28 2015, 5:08 AM
Steinsplitter awarded a token.Jan 28 2015, 10:53 AM
Jalexander awarded a token.Apr 20 2015, 7:51 AM
Jalexander subscribed.
Liuxinyu970226 subscribed.May 19 2015, 5:50 AM
He7d3r mentioned this in T48716: Translation page does not contain the latest translations/last translation.Jun 9 2015, 6:40 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 21 2015, 7:52 PM
revi mentioned this in T56579: Incomplete setup of translatable pages: FuzzyBot fails to generate /en subpage etc..Sep 23 2015, 12:33 PM
hashar changed the status of subtask T40945: Need a way to simulate replication lag to test replag issues from Open to Stalled.Nov 9 2015, 1:11 PM
Stryn subscribed.Jan 30 2016, 10:19 PM
Trijnstel subscribed.Feb 20 2016, 5:16 PM
• Elitre subscribed.Feb 29 2016, 3:01 PM
Nikerabbit merged a task: T127651: Transclusion and translation of translatable template doesn't work.Mar 23 2016, 7:58 AM
Nikerabbit added subscribers: JanZerebecki, hoo, .js, StudiesWorld.
Nikerabbit added a project: Language-Engineering April-June 2016.Mar 23 2016, 8:53 AM
Nikerabbit moved this task from Backlog to Translate on the Language-Engineering April-June 2016 board.
Glaisher subscribed.Mar 23 2016, 3:08 PM
Glaisher added a comment.Mar 25 2016, 5:09 PM

I spent some time these 3 days trying to debug this as it's one of the most annoying bugs I encounter while working with translatable pages on Meta.

From my investigation, I think it's safe to conclude that this is not related to slave lag as I don't have a master/slave setup locally but am able to reproduce it. The job runner is configured as the default and also with default rate (no dedicated job runner like redis; jobs are run within the Special:RunJobs request itself).

In SpecialPageTranslation::markForTranslation(), TranslateRenderJobs for updating the translation pages are pushed to the queue first and then MessageUpdateJobs are pushed to the queue to update the translation units. These jobs can be run in any order but usually it's sequentially (I think). However, TranslateRenderJob depends on the translation units to be updated through MessageUpdateJobs before it is run because TranslateRenderJob retrieves the content for the translation page edit through the updates from that job.

To confirm this and to make it easier to debug, I locally hacked markForTranslation() to make the jobs be run() immediately instead of pushing them to the queue. If the order is changed so that getTranslationUnitJobs() is run before getRenderJobs(), this bug cannot be reproduced at all but is present if it's in the current order. Note that the /en page would be updated but this is because of the edits to the unit pages which trigger the hook making the TranslateRenderJob be run repeatedly on that page. We should probably stop doing that.

Nikerabbit added a comment.Mar 25 2016, 5:14 PM

Thanks a lot for looking into this, it is very helpful, especially the part about reproducing which I have not been able to for some reason (not trying hard enough?). I hope we are going to start fixing this very soon now :)

gerritbot subscribed.Mar 25 2016, 5:19 PM

Change 279635 had a related patch set uploaded (by Glaisher):
Make sure MessageUpdateJobs are run before TranslateRenderJobs when marking

https://gerrit.wikimedia.org/r/279635

gerritbot added a project: Patch-For-Review.Mar 25 2016, 5:19 PM
Nemo_bis mentioned this in T47894: Async and non-atomic saving of page translation edits?.Mar 25 2016, 5:25 PM
Glaisher added a comment.Mar 25 2016, 5:38 PM

Steps to reproduce:

  1. Create a translatable page and mark for translation
  2. Add a translation somewhere.
  3. Update the source page and mark for translation with invalidation enabled.
  4. Changes are not propagated to the translated page.

See https://meta.wikimedia.org/wiki/User:Glaisher/T53731 and https://meta.wikimedia.org/wiki/User:Glaisher/T53731/es (with history and logs). Also see https://meta.wikimedia.org/wiki/User:Glaisher/T53731/en
It cannot be reproduced if there was no change to a translation between the mark. I guess it's because TPParse::getText() filters for translated messages only?

gerritbot added a comment.Mar 30 2016, 2:48 PM

Change 279635 merged by jenkins-bot:
Make sure MessageUpdateJobs are run before TranslateRenderJobs when marking

https://gerrit.wikimedia.org/r/279635

Nikerabbit updated the task description. (Show Details)Mar 30 2016, 2:54 PM
Nikerabbit updated the task description. (Show Details)
Nikerabbit removed a project: Patch-For-Review.Mar 30 2016, 2:58 PM

Once the patch is deployed, refresh-translatable-pages needs to be run on all wikis using Translate.

Nikerabbit removed a subtask: T40945: Need a way to simulate replication lag to test replag issues.Mar 30 2016, 3:00 PM
Nikerabbit removed a parent task: T3268: Database replication lag issues (tracking).
ReleaseTaggerBot added a project: MW-1.27-release (WMF-deploy-2016-04-05_(1.27.0-wmf.20)).Mar 31 2016, 9:02 AM
Nikerabbit closed this task as Resolved.Apr 11 2016, 7:22 AM
Nikerabbit assigned this task to Glaisher.

I am marking this resolved. Using the tracker for follow-up work instead.

Nikerabbit added a parent task: T48716: Translation page does not contain the latest translations/last translation.Apr 11 2016, 7:23 AM
Nikerabbit merged a task: T117759: UI update erratic/erroneous.Apr 13 2016, 6:47 AM
Nikerabbit added a subscriber: Malenki.
Liuxinyu970226 unsubscribed.Apr 13 2016, 10:34 AM
Glaisher added a comment.Apr 14 2016, 1:07 PM

Note: I was just looking at https://grafana.wikimedia.org/dashboard/db/job-queue-rate and noticed that the new job (TranslationsUpdateJob) might take some time (on avg. 4 min, I also see one that took an hour) to complete before the updates will be visible on the page but we can now be sure that the updates would be from the latest changes.

Nikerabbit added a comment.Apr 14 2016, 5:10 PM

That doesn't seem to tell how much is queue time and how much is execution time. Also the avg might be misleading and median and 90% percentile could be more interesting.

Also MessageIndexRebuildJobs are prioritized, but these new jobs are not. That should probably be changed to prioritize this new Job type instead.

Nikerabbit added a comment.Apr 14 2016, 5:22 PM

https://github.com/wikimedia/operations-puppet/blob/64fe18b105a26c08cdf64114cc46326aca0ec94d/modules/mediawiki/templates/jobrunner/jobrunner.conf.erb#L58-L63 + L12

gerritbot added a comment.Apr 17 2016, 5:49 AM

Change 283841 had a related patch set uploaded (by Glaisher):
Add TranslationsUpdateJob to translate job runner group

https://gerrit.wikimedia.org/r/283841

gerritbot added a project: Patch-For-Review.Apr 17 2016, 5:49 AM
gerritbot added a comment.May 10 2016, 4:28 PM

Change 283841 merged by Giuseppe Lavagetto:
Add TranslationsUpdateJob to translate job runner group

https://gerrit.wikimedia.org/r/283841

Joe mentioned this in rOPUP76879b3bf464: Add TranslationsUpdateJob to translate job runner group.May 10 2016, 4:32 PM
Kaganer subscribed.Jun 6 2016, 12:42 PM
Nemo_bis updated the task description. (Show Details)Feb 13 2017, 8:26 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits