Pagecounts dataset has been deprecated, but it used to be automatically synced to labs at /public/dumps. We should make sure they same happens for the new pageviews dataset.
This should be changed:
https://github.com/wikimedia/operations-puppet/blob/f4f87efce1fcaab1296f2b9ee31a429b391af6c3/modules/role/manifests/labs/nfs/misc.pp#L25
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Rsync pageviews to labs nfs hosts | operations/puppet | production | +1 -0 |
See this announcement on the Analytics public mailing list:
https://lists.wikimedia.org/pipermail/analytics/2016-August/005339.html
Could we perhaps get https://dumps.wikimedia.org/other/pageviews into /public/dumps/pageviews then?
Any chance for this to be expedited? At nowiki we are currently using these datasets for a local stats-service (https://tools.wmflabs.org/pagecount/) and the users are complaining (https://no.wikipedia.org/wiki/Wikipedia:Torget#Sidevisningsstatistikk)...
Change 307502 had a related patch set uploaded (by Ottomata):
Rsync pageviews to labs nfs hosts
Done! I'm running the first rsync over now.
I didn't create a specific rsync module, it seems like the ::dumps one should be enough.
@Stigmj, I don't have a full understanding of how the /public/dumps NFS mount works in labs, but I think that /public/dumps/pageviews should exist now. Can you confirm?