Eventlogging monitoring of consumers (process nanny)
Closed, DeclinedPublic
Actions

Assigned To

Authored By

	• Nuria
	Oct 14 2015, 4:35 PM

Description

It is happen that EL mysql consumer has silently 'died', we need to get an alarm when process is not up.

https://engineering.linkedin.com/apache-kafka/burrow-kafka-consumer-monitoring-reinvented

Related Objects

Mentioned Here: T118315: EventLogging Kafka consumer stops consuming after Kafka metadata change. See if upgrade fixes it. {oryx} [13 pts]

Event Timeline

• Nuria created this task.Oct 14 2015, 4:35 PM

• Nuria raised the priority of this task from to Needs Triage.

• Nuria updated the task description. (Show Details)

• Nuria added subscribers: • Nuria, MediaWiki-extensions-EventLogging, Ottomata and 2 others.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 14 2015, 4:35 PM

Hi @Nuria. Please associate at least one project with this task, otherwise nobody can find this task when searching in the corresponding project(s). Thanks.

Aklapper added projects: Analytics-Backlog, Analytics-Kanban, MediaWiki-extensions-EventLogging.Oct 14 2015, 7:40 PM

Aklapper set Security to None.

This isn't true. The consumer did die, but was started back up. There is already alerting in place to notify if the process is down.

What happened is, something stopped consuming from Kafka. I haven't had time to investigate into what, but something did. It may have been just the MySQL consumer, it may have been more.

JAllemandou removed a project: Analytics-Kanban.Nov 5 2015, 6:21 PM

Restricted Application added a subscriber: StudiesWorld. · View Herald TranscriptNov 5 2015, 6:21 PM

Declined in favor of T118315

Aklapper removed a subscriber: MediaWiki-extensions-EventLogging.May 16 2023, 11:37 AM

Restricted Application added a project: Data-Engineering. · View Herald TranscriptMay 16 2023, 11:37 AM

Eventlogging monitoring of consumers (process nanny)Closed, DeclinedPublicActions

Description

Related Objects

Event Timeline

Eventlogging monitoring of consumers (process nanny)
Closed, DeclinedPublic
Actions