Page MenuHomePhabricator
Create Task
Maniphest T94592

Process new PV hourly dumps for Vital Signs {hawk}
Closed, DuplicatePublic
Actions

Description

Take the hourly dumps of raw PV counts (using the new PV definition & UDF) and process them to generate Vital Signs compatible files with monthly and daily aggregations per project.

The current process (which uses the old PV definition) takes files

The new process should dump files in a new directory (so we can display both old and new metrics at the same time). For example:
https://metrics.wmflabs.org/static/public/datafiles/Pageviews_New_Daily/
https://metrics.wmflabs.org/static/public/datafiles/Pageviews_New_Monthly/

Related Objects
Search...

Event Timeline

• kevinator created this task.Mar 31 2015, 5:52 PM
• kevinator raised the priority of this task from to Needs Triage.
• kevinator updated the task description. (Show Details)
• kevinator added projects: Analytics-Clusters, Analytics-Kanban.
• kevinator subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 31 2015, 5:52 PM
• kevinator added a comment.Mar 31 2015, 5:53 PM

I think we also want to think about how Vital Signs could display a total for all projects. Would such a total exist in an 'allprojects.json' file? That needs more discussion. The allprojects would also need to exist for the other metrics in Vital Signs.

• kevinator triaged this task as Medium priority.Mar 31 2015, 5:55 PM
• kevinator added a subtask: T69804: Story: AnalyticsEng has hourly PageView counts {hawk}.
• kevinator set Security to None.
• kevinator updated the task description. (Show Details)Mar 31 2015, 6:02 PM
• ggellerman edited projects, added Analytics-Backlog; removed Analytics-Kanban.Jun 12 2015, 9:34 PM
• ggellerman moved this task from Incoming to Backlog on the Analytics-Backlog board.Jul 10 2015, 10:56 PM
• ggellerman edited projects, added Analytics; removed Analytics-Backlog.Jan 12 2016, 7:41 PM
Milimetric moved this task from Incoming to Event Platform on the Analytics board.Jan 12 2016, 7:42 PM
• kevinator removed a project: Analytics-Clusters.EditedFeb 3 2016, 10:52 PM

we're moving towards an API to get the data, so this does not seem as relevant anymore.
T124063: Make Dashiki get pageview data from pageview API {melc}

showing monthly pageviews in vital signs should be a separate task.

• kevinator closed this task as a duplicate of T124063: Make Dashiki get pageview data from pageview API {melc}.Feb 3 2016, 10:54 PM
Milimetric closed subtask T69804: Story: AnalyticsEng has hourly PageView counts {hawk} as Resolved.Oct 3 2016, 3:57 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL