Page MenuHomePhabricator

Configuration for Python & Kafka in Beta labs [8 points] {oryx}
Closed, DuplicatePublic

Description

  • Configure a new Event Logging Processor to read/write using Kafka instead of zmq (write server and client side events to the same topic, no need for multiplexor)
  • Configure new Event Logging Log Consumers to read/write using Kafka
  • Change the Mysql Consumer to read from Kafka

Madhu to pair with Dan

Event Timeline

ggellerman assigned this task to madhuvishy.
ggellerman raised the priority of this task from to Needs Triage.
ggellerman updated the task description. (Show Details)
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 11 2015, 9:17 PM

Change 210765 had a related patch set uploaded (by Milimetric):
[WIP] Add parallel kafka pipeline

https://gerrit.wikimedia.org/r/210765

Milimetric renamed this task from Configuration for Python & Kafka in Beta labs [8 points] to Configuration for Python & Kafka in Beta labs [8 points] {oryx}.May 19 2015, 4:19 PM
Milimetric set Security to None.
kevinator moved this task from Paused to Done on the Analytics-Kanban board.Jun 1 2015, 3:49 PM

Change 210765 merged by Ottomata:
Modify eventlogging module to use new changes to eventlogging server

https://gerrit.wikimedia.org/r/210765