Page MenuHomePhabricator

Kibana dashboard mediawiki-errors lacks channel errors and exceptions
Open, Needs TriagePublic

Description

https://logstash.wikimedia.org/app/dashboards#/view/mediawiki-errors has a filter for error channels.

FieldValue
typemediawiki
channel.keywordexception error jsonTruncated

That excludes ERROR level messages from other channels and exceptions which are in the exception channel but otherwise lack a level. The dashboard thus reflects a partial view of all errors.

I found that out a fairly recently and removing the current filter is how I caught ExtensionDistributor throwing errors (T340483). The reported issue had:

FieldValue
channelExtensionDistributor
levelERROR
typemediawiki

A filter letting any ERROR (regardless of channel) and any message to the exception channel (regardless of level) would have shown the issue.