Pageviews dumps stalled
Closed, ResolvedPublic

Description

Author: metatron

Description:
Pageviews dumps dried out. Last dump provided: pagecounts-20140530-150000


Version: unspecified
Severity: major
Whiteboard: u=caistleitner@wikimedia.org c=General/Unknown p=0 s=2014-05-29

bzimport set Reference to bz65978.
bzimport created this task.Via LegacyMay 31 2014, 5:23 PM
Aklapper added a comment.Via ConduitMay 31 2014, 9:24 PM

metatron: Please provide a URL to reproduce / see the problem.
I assume this is some page somewhere on http://dumps.wikimedia.org/

QChris added a comment.Via ConduitJun 2 2014, 7:36 AM

The files are still there on gadolinium, so it looks like we're not loosing data,
but "only" copying the data files around is failing.

gerritbot added a comment.Via ConduitJun 2 2014, 9:28 AM

Change 136735 had a related patch set uploaded by QChris:
Provide default shell to datasets user

https://gerrit.wikimedia.org/r/136735

gerritbot added a comment.Via ConduitJun 2 2014, 9:30 AM

Change 136735 abandoned by QChris:
Provide default shell to datasets user

Reason:
Beaten by Change 136734

https://gerrit.wikimedia.org/r/136735

QChris added a comment.Via ConduitJun 2 2014, 9:35 AM

It seems Ops' cleanup around accounts reset the datasets user's shell,
so rsync failed. Apergos set rsync's shell again in

https://gerrit.wikimedia.org/r/#/c/136734

. That should fix the issue upon the next cron run and bring the missing
files over.
I'll report back when that happened.

QChris added a comment.Via ConduitJun 2 2014, 10:39 AM

The fix worked.
Files are back.
No missing data.

bzimport added a comment.Via ConduitJun 2 2014, 1:46 PM

otto wrote:

Thanks Christian and Ariel (and all)!

Add Comment

Column Prototype
This is a very early prototype of a persistent column. It is not expected to work yet, and leaving it open will activate other new features which will break things. Press "\" (backslash) on your keyboard to close it now.