Page MenuHomePhabricator
Create Task
Maniphest T187426

enwiki-latest-md5sums.txt is no longer updated
Closed, ResolvedPublic
Actions

Description

Update of file enwiki-latest-md5sums.txt stopped in November 2017. Problem is also relevant for other languages. File can be found here https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-md5sums.txt

Details

SubjectRepoBranchLines +/-
rsync txt files from dumps 'latest' directories to webserveroperations/puppetproduction+2 -1
Customize query in gerrit

Related Objects

Event Timeline

Mligas82 created this task.Feb 15 2018, 7:38 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 15 2018, 7:38 AM
Legoktm added a project: Dumps-Generation.Feb 15 2018, 8:02 AM
ArielGlenn claimed this task.Feb 15 2018, 10:01 AM
ArielGlenn triaged this task as Medium priority.
ArielGlenn added a comment.Feb 15 2018, 3:47 PM

I believe this is a side-effect of T185454 and fixed with the commit mentioned there. Local testing with the latest deployed code does not show this issue. We won't know for sure until the next run on the 20th so I'll keep this ticket open.

ArielGlenn moved this task from Backlog to Active on the Dumps-Generation board.Feb 15 2018, 3:47 PM
ArielGlenn added a comment.Feb 27 2018, 2:33 PM

This is still a problem after the Feb 20th run. There must be an additional issue, having a look.

ArielGlenn added a comment.Feb 27 2018, 4:19 PM

OK, I take it back. The only ones for which the files were not updated, are wiki projects which have been deleted in the meantime. What's happening instead is that the rsyncs aren't copying over these links from the dumps generation hosts to the web server. I'll check on that.

gerritbot subscribed.Feb 27 2018, 4:47 PM

Change 415042 had a related patch set uploaded (by ArielGlenn; owner: ArielGlenn):
[operations/puppet@production] rsync txt files from dumps 'latest' directories to webserver

https://gerrit.wikimedia.org/r/415042

gerritbot added a project: Patch-For-Review.Feb 27 2018, 4:47 PM
gerritbot added a comment.Feb 27 2018, 5:38 PM

Change 415042 merged by ArielGlenn:
[operations/puppet@production] rsync txt files from dumps 'latest' directories to webserver

https://gerrit.wikimedia.org/r/415042

ArielGlenn closed this task as Resolved.Feb 27 2018, 6:43 PM

Rsync is working, files have shown up. Closing this ticket.

ArielGlenn moved this task from Active to Done on the Dumps-Generation board.Mar 2 2018, 10:40 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL