Since 11:42 UTC the database server s2/s4/s5 is unreachable and ganglia shows no io for this server.
Version: unspecified
Severity: major
URL: https://ganglia.wikimedia.org/latest/?c=MySQL%20eqiad&h=labsdb1002.eqiad.wmnet&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | jcrespo | T50930 Database replication problems - production and labs (tracking) | |||
| Resolved | • Springle | T71144 mariadb10 s2/s4/s5 unreachable |
The crash was similar to https://mariadb.atlassian.net/browse/MDEV-6455, with same assertion failure but a DELETE stack trace instead of UPDATE. Needs more research including labsdb1002 reconfiguration to collect a core file should it recur.
(In reply to Sean Pringle from comment #1)
segfault. System is back online. Still investigating.
-> Lowering severity/priority of this ticket
This hasn't recurred, plus the box has been since upgraded to MariaDB 10.0.14 which is listed as including the MDEV 6455 fix. Worth watching carefully, but no need to keep this bug open.