Page MenuHomePhabricator

Load media requests data into cassandra
Open, HighPublic

Description

Once the current mediacounts dataset has been backfilled with the agent_type, media_classification and file_type fields, we need to load them to cassandrato expose the metric in AQS.

There is not "project" in this dataset rather project appears as one of the possible referrers of a file (external, internal, unknown or say, 'es.wikipedia.org")

Event Timeline

fdans created this task.Jul 16 2019, 10:16 AM
fdans updated the task description. (Show Details)Jul 16 2019, 10:50 AM
fdans updated the task description. (Show Details)
Milimetric triaged this task as High priority.Jul 18 2019, 4:38 PM
Milimetric moved this task from Incoming to Analytics Query Service on the Analytics board.
Nuria renamed this task from Load media requests data into cassandra (or druid?) to Load media requests data into cassandra .Fri, Aug 30, 8:54 AM
Nuria updated the task description. (Show Details)
Krinkle removed a subscriber: Krinkle.Fri, Aug 30, 4:03 PM

Change 533921 had a related patch set uploaded (by Fdans; owner: Fdans):
[analytics/refinery@master] (wip) Add cassandra loading job for requests per file metric

https://gerrit.wikimedia.org/r/533921

Change 533921 merged by Fdans:
[analytics/refinery@master] Add cassandra loading job for mediarequests per file metric

https://gerrit.wikimedia.org/r/533921

fdans claimed this task.Fri, Sep 13, 4:02 PM
fdans added a project: Analytics-Kanban.
fdans moved this task from Next Up to Ready to Deploy on the Analytics-Kanban board.