Coal graphs died around 2021-01-26 20:50 UTC
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• Gilles
	Jan 27 2021, 9:17 AM

Description

Screenshot 2021-01-27 at 10.16.44.png (714×1 px, 64 KB)

Most likely caused by the event pipeline migration. More specifically, the new dependency on snappy:

Jan 27 01:17:14 webperf1001 coal[15220]: kafka.errors.UnsupportedCodecError: UnsupportedCodecError: Libraries for snappy compression codec not found

Details

	Subject	Repo	Branch	Lines +/-
	Add snappy dependency to coal	operations/puppet	production	+1 -1

Customize query in gerrit

Event Timeline

• Gilles created this task.Jan 27 2021, 9:17 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 27 2021, 9:17 AM

Change 658918 had a related patch set uploaded (by Gilles; owner: Gilles):
[operations/puppet@production] Add snappy dependency to coal

https://gerrit.wikimedia.org/r/658918

gerritbot added a project: Patch-For-Review.Jan 27 2021, 9:22 AM

Seems like coal simply needed to be restarted, it hadn't been since python3-snappy was installed on the host a few days ago for navtiming's sake. Won't hurt to make the dependency explicit anyway.

• Gilles triaged this task as High priority.Jan 27 2021, 9:36 AM

Change 658918 merged by Ottomata:
[operations/puppet@production] Add snappy dependency to coal

https://gerrit.wikimedia.org/r/658918

Maintenance_bot removed a project: Patch-For-Review.Jan 27 2021, 3:10 PM

Restarting coal fixed the data, as expected:

Screenshot 2021-01-27 at 17.00.14.png (379×839 px, 28 KB)

	F34044291: Screenshot 2021-01-27 at 17.00.14.png
	Jan 27 2021, 4:00 PM

	F34037897: Screenshot 2021-01-27 at 10.16.44.png
	Jan 27 2021, 9:17 AM

Coal graphs died around 2021-01-26 20:50 UTCClosed, ResolvedPublicActions

Description

Details

Event Timeline

Coal graphs died around 2021-01-26 20:50 UTC
Closed, ResolvedPublic
Actions