labsdb1005's mysql crashed
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	jcrespo
	Oct 16 2017, 9:01 AM

Description

2017-10-15 19:25:07 7f75ac3fe700  InnoDB: Assertion failure in thread 140143377770240 in file srv0srv.cc line 2263
InnoDB: We intentionally generate a memory trap.

Related Objects

Mentioned In: T178294: User log table creation on tools.labsdb failing intermittantly for IABot interactive UI

Event Timeline

jcrespo created this task.Oct 16 2017, 9:01 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 16 2017, 9:01 AM

There is not much to do, this is memory exhaustion/load coming from templatetiger/external links monitor.

The high load, however, continues: https://grafana.wikimedia.org/dashboard/file/server-board.json?refresh=1m&panelId=19&fullscreen&orgId=1&var-server=labsdb1005&var-network=bond0&from=now-7d&to=now

• Marostegui moved this task from Triage to In progress on the DBA board.Oct 16 2017, 11:11 AM

bd808 mentioned this in T178294: User log table creation on tools.labsdb failing intermittantly for IABot interactive UI.Oct 16 2017, 3:20 PM

The high load looks gone (or at least as it used to be before): https://grafana.wikimedia.org/dashboard/file/server-board.json?refresh=1m&panelId=19&fullscreen&orgId=1&var-server=labsdb1005&var-network=bond0&from=1507562558281&to=1508167358281

bd808 moved this task from Backlog to ToolsDB on the Data-Services board.Oct 16 2017, 6:56 PM

The load seems back to previous levels: https://grafana.wikimedia.org/dashboard/file/server-board.json?refresh=1m&panelId=19&fullscreen&orgId=1&var-server=labsdb1005&var-network=bond0&from=1507622864810&to=1508227664810
Let's close this as it looks resolved (at least for now)

labsdb1005's mysql crashedClosed, ResolvedPublicActions

Description

Related Objects

Event Timeline

labsdb1005's mysql crashed
Closed, ResolvedPublic
Actions