Page MenuHomePhabricator

Dumps not transferring to labs
Closed, InvalidPublic

Description

No dumps were transferred at the beginning month's run until I complained on the wmflabs mailing list.. Dumps started, but only those that had finished were transferred. Other dumps, such as the still processing enwiki, were never transferred.

No dumps from the mid-month runs have transferred.

Event Timeline

I see the enwiki 2016 Aug 20, Sept 1 and Sept 20 dumps all on labstore1003 in the right place (/srv/dumps/public/<wiki>/<date>). I chose a random wiki (el wiktionary) and I see Aug 20, Sept 1 there and the files from Sept 20 that are complete.

Can you point me to something that is missing?

When I emailed you the first time, there were no 20160920 directories (ruwiki and enwiki). Now there are. However, only files finished on the 20th have been transferred. (ruwiki, frwiki and svwiki)

I was emailed on the 8th about the output to a program for enwiki. There was no 20160901 directory. Neither were there directories for dewiki and frwiki.

It used to be that when a file was finished, it was transferred to labs. Now it appears it transfers things over at some random time.

We generate a list of completed files for our rsync mirrors, once a day. We use this same list for our internal rsync to labs, which is also once a day. That means the files can be nearly 2 days behind, but no more than that, for any completed dump step on a given wiki. That's on my end.

Given the above, I can see why you see a lag, as noted with ru fr and svwiki. I can't determine why there would have been no directory for en wiki on Septermber 8th, and I have no way to backtrack that from here. Logs are long gone and I had no warning email from cron (I check those every day). I can hope it was something on the labs end that was now fixed, but honestly I should have seen some failure output via email.

Hydriz subscribed.

Nothing we can do here. Dumps for October 2016 is transferring fine as far as I can see.