Reimage db1021 database
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	jcrespo
	Feb 15 2016, 5:18 PM

Description

It crashed with corrupted pages. Related to T126451 ?

Details

	Subject	Repo	Branch	Lines +/-
	Repool db1021 and db1024, both with low/non critical load	operations/mediawiki-config	master	+6 -6
	database: Reimage db1021 with Jessie	operations/puppet	production	+2 -0

Customize query in gerrit

Related Objects

Mentioned Here: T126451: db1021 degraded RAID

Event Timeline

jcrespo created this task.Feb 15 2016, 5:18 PM

jcrespo raised the priority of this task from to Needs Triage.

jcrespo updated the task description. (Show Details)

jcrespo added a project: DBA.

jcrespo subscribed.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptFeb 15 2016, 5:18 PM

Change 270983 had a related patch set uploaded (by Volans):
database: Reimage db1021 with Jessie

https://gerrit.wikimedia.org/r/270983

gerritbot added a project: Patch-For-Review.Feb 16 2016, 4:19 PM

Change 270983 merged by Volans:
database: Reimage db1021 with Jessie

https://gerrit.wikimedia.org/r/270983

Mentioned in SAL [2016-02-16T17:07:01Z] <volans> Disabled puppet on db1021 for reimaging: T126996

Mentioned in SAL [2016-02-16T17:26:30Z] <volans> Reboot+reimage of db1021 (T126996)

jcrespo assigned this task to Volans.Feb 16 2016, 5:55 PM

jcrespo triaged this task as Medium priority.

jcrespo moved this task from Triage to In progress on the DBA board.

Server reimaged, puppet and salt registered and running. No data yet

Loading data from db1024.

Logical import has been done and the slave has caught up, waiting a bit before repool.

When repooling, it must be done with minimal load, as I do not fully trust our mysql puppet grants to be fully up-to-date. Everything else seems to be working nicely.

Change 273196 had a related patch set uploaded (by Jcrespo):
Repool db1021 and db1024, both with low/non critical load

https://gerrit.wikimedia.org/r/273196

Change 273196 merged by Jcrespo:
Repool db1021 and db1024, both with low/non critical load