Page MenuHomePhabricator

Data missing from WCQS
Closed, ResolvedPublic5 Estimated Story Points

Description

It seems that the last weekly import to WCQS has failed. The last available data in WCQS (as of Tuesday, April 13 2021) is from March 29 2021.

We noticed this when looking at this query, which is getting all of the images from this category and ranking them by number of depicts statements. Many of the images in the category are not appearing in the results.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Zbyszko set the point value for this task to 5.
Zbyszko moved this task from Incoming to In Progress on the Discovery-Search (Current work) board.

Currently, last available data in WCQS is from April 3rd, so we're 2 weeks behind. It turns out that commons dump generation time grew and its end overtook our Monday's reload beginning. This means that each Monday for the last few weeks, when the reload was happening, latest available dump was almost a week old. I'll change the schedule to start on Tuesday - should be enough for some time, considering we're working on a continuous process.

Change 681331 had a related patch set uploaded (by ZPapierski; author: ZPapierski):

[operations/puppet@production] Move WCQS update to Tuesday

https://gerrit.wikimedia.org/r/681331

Change 681331 merged by Ryan Kemper:

[operations/puppet@production] Move WCQS update to Tuesday

https://gerrit.wikimedia.org/r/681331