Page MenuHomePhabricator

EventLogging fails to validate a Recentchanges event for
Closed, ResolvedPublic


EventLogging is reporting failures, and the problem seems to be the following (already decoded):

Unable to validate: ?{"event":{"pagename":"Recentchanges","hidepatrolled":true,"namespace":"0"},"schema":"ChangesListFilters","revision":[REDACTED],"clientValidated":false,"wiki":"hewiki","webHost":"","userAgent":"REDACTED"};   cp1066.eqiad.wmnet      6020266 2017-01-01T11:16:03     -       "MediaWiki/1.29.0-wmf.6" (u'0' is not of type 'integer')

(the REDACTED parts can be found in the logs on eventlog1001).

Event Timeline

elukey created this task.Jan 1 2017, 11:20 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 1 2017, 11:20 AM
elukey triaged this task as Medium priority.Jan 1 2017, 11:20 AM
Nuria added a subscriber: Nuria.Jan 4 2017, 7:00 PM


Notification Type: PROBLEM

Service: Throughput of EventLogging EventError events
Host: graphite1001

Date/Time: Sun Jan 1 10:29:21 UTC 2017

Additional Info:

CRITICAL: 71.43% of data above the critical threshold [30.0]

Nuria added a comment.EditedJan 4 2017, 7:00 PM

See spike on errors, it appears as a spike on EventError schema. Spike has since then decreased and I think alarm can be reseted.

Note to self: see actual EventErrors: kafkacat -C -b kafka1014.eqiad.wmnet -t eventlogging_EventError

Nuria added a comment.Jan 4 2017, 7:56 PM

Looked at events on errors and agree with initial diagnosis about events ChangesListFilters being on error. Assigning to Roan which seems to be the schema owner ( . Please be so kind to fix validation errors or let us know if this schema is no longer used.

Nuria assigned this task to Catrope.Jan 4 2017, 7:56 PM
Nuria edited projects, added Analytics-Kanban; removed Analytics.Jan 4 2017, 8:07 PM
Nuria moved this task from Next Up to Paused on the Analytics-Kanban board.

Change 330973 had a related patch set uploaded (by Catrope):
onChangesListSpecialPageFilters: Actually treat namespace as an integer

Nuria closed this task as Resolved.Jan 30 2017, 4:51 PM

Change 330973 merged by jenkins-bot:
onChangesListSpecialPageFilters: Actually treat namespace as an integer