Page MenuHomePhabricator

Missing data in virtualpageview_hourly table since April 15, 2021
Closed, ResolvedPublic

Description

There seems to be no data for virtualpageview_hourly table since April 15, 2021. Is this related to event platform migration for VirtualPageView T238138?

Event Timeline

Milimetric triaged this task as Unbreak Now! priority.
Milimetric added a project: Analytics-Kanban.
Milimetric added a subscriber: Milimetric.

Culprit is uppercase mismatch, so druid jobs weren't finding the data: https://github.com/wikimedia/analytics-refinery/blob/master/oozie/virtualpageview/druid/daily/coordinator.properties#L48

Marcel & Andrew will action

Change 690607 had a related patch set uploaded (by Mforns; author: Mforns):

[analytics/refinery@master] Fix broken jobs due to lowercasing of event db data directories

https://gerrit.wikimedia.org/r/690607

Change 690607 merged by Mforns:

[analytics/refinery@master] Fix broken jobs due to lowercasing of event db data directories

https://gerrit.wikimedia.org/r/690607

This has been fixed and the jobs are back-filling both Hive and Druid (Turnilo).
It will take a couple days to catch up, though.
Thanks for the report!