Page MenuHomePhabricator

Add kafka log files to logstash
Open, MediumPublic

Description

To help reduce the cycle time of debugging kafka it would be useful to have the following log files stored and processed by logstash:

  • kafka broker log files from an21 and an22
  • kafka consumer log files from the edge caches
  • kafka producer log files

Version: wmf-deployment
Severity: enhancement

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 3:03 AM
bzimport set Reference to bz61788.
bzimport added a subscriber: Unknown Object (MLST).

Change 476982 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] logstash: ship kafka server logs to ELK

https://gerrit.wikimedia.org/r/476982

Change 476982 merged by Herron:
[operations/puppet@production] logstash: ship kafka server logs to ELK

https://gerrit.wikimedia.org/r/476982