Page MenuHomePhabricator

Stream maps cluster requests into HDFS [3pts] {hawk}
Closed, ResolvedPublic

Description

Requests from the maps cluster are now flowing into Kafka and streaming across, but aren't actually going anywhere. The Maps team would like this data to be pushed into Hadoop as a new webrequest_source ("maps", presumably) so that it's possible to analyse Maps requests.

Event Timeline

Ironholds raised the priority of this task from to Needs Triage.
Ironholds updated the task description. (Show Details)
Ironholds added a project: Analytics-Backlog.
Ironholds added a subscriber: Ironholds.

Change 230535 had a related patch set uploaded (by Yurik):
Make camus import webrequest_maps from new maps varnish cluster

https://gerrit.wikimedia.org/r/230535

Tfinc set Security to None.
Tfinc moved this task from Backlog to Stalled/Waiting on the Maps-Sprint board.
JAllemandou renamed this task from Stream maps cluster requests into HDFS to Stream maps cluster requests into HDFS [3pts] {hawk}.Aug 12 2015, 2:38 PM

Change 230535 abandoned by Ottomata:
Make camus import webrequest_maps from new maps varnish cluster

Reason:
This was done by joseph in another commit.

https://gerrit.wikimedia.org/r/230535

Restricted Application added a subscriber: StudiesWorld. · View Herald Transcript