Page MenuHomePhabricator

Process new PV hourly dumps for Vital Signs {hawk}
Closed, DuplicatePublic

Description

Take the hourly dumps of raw PV counts (using the new PV definition & UDF) and process them to generate Vital Signs compatible files with monthly and daily aggregations per project.

The current process (which uses the old PV definition) takes files

The new process should dump files in a new directory (so we can display both old and new metrics at the same time). For example:
https://metrics.wmflabs.org/static/public/datafiles/Pageviews_New_Daily/
https://metrics.wmflabs.org/static/public/datafiles/Pageviews_New_Monthly/

Event Timeline

kevinator raised the priority of this task from to Needs Triage.
kevinator updated the task description. (Show Details)
kevinator added a subscriber: kevinator.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 31 2015, 5:52 PM

I think we also want to think about how Vital Signs could display a total for all projects. Would such a total exist in an 'allprojects.json' file? That needs more discussion. The allprojects would also need to exist for the other metrics in Vital Signs.

we're moving towards an API to get the data, so this does not seem as relevant anymore.
T124063: Make Dashiki get pageview data from pageview API {melc}

showing monthly pageviews in vital signs should be a separate task.