Logstash in Beta Cluster stopped ingesting messages from MediaWiki
Closed, DuplicatePublic
Actions

Assigned To

None

Authored By

	Krinkle
	Dec 4 2019, 10:12 PM

Description

Fatal monitor, mediawiki-errors etc, no longer showing any messages, including when e.g. enabling WikimediaDebug with verbose logging.

Mentioned Here: T211984: Logstash in beta fails periodically
T233134: logstash-beta.wmflabs.org does not receive any mediawiki events

@colewhite wrote at https://gerrit.wikimedia.org/r/554599:

seeing rsyslog complaining about "omkafka: kafka delivery FAIL" on deployment-prep hosts.