Page MenuHomePhabricator

Decommission db1051
Closed, ResolvedPublic

Description

*Note: eighth disk, starting from 0, had smart errors*

db1051used to be the m2 master, after failing it over, make it ready for decom.

  • Change m2 master from db1051 to db1065

Decommission Checklist

START NON-INTERRUPPTABLE STEPS - please assign to @RobH for the non-interrupt steps

  • - disable puppet on host
  • - power down host
  • - disable switch port
  • - switch port assignment noted on this task (for later removal) asw2-b-eqiad:ge-3/0/1
  • - remove all remaining puppet references (include role::spare)
  • - remove production dns entries
  • - puppet node clean, puppet node deactivate

END NON-INTERRUPPTABLE STEPS

  • - mark disk #8 as non usable - it has smart errors
  • - system disks wiped (by onsite)
  • - IF DECOM: system unracked and decommissioned (by onsite), update racktables with result
  • - IF DECOM: switch port configration removed from switch once system is unracked.
  • - IF DECOM: add system to decommission tracking google sheet
  • - IF DECOM: mgmt dns entries removed.

Related Objects

StatusSubtypeAssignedTask
ResolvedNone
Resolved Cmjohnson

Event Timeline

jcrespo triaged this task as Medium priority.May 24 2018, 1:38 PM
jcrespo created this task.

Change 434916 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Failover m2 master to db1065 instad of db2044

https://gerrit.wikimedia.org/r/434916

Change 434916 merged by Jcrespo:
[operations/puppet@production] mariadb: Failover m2 master to db1065 instad of db2044

https://gerrit.wikimedia.org/r/434916

Change 437769 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software@master] mariadb: Remove db1051, to be decommissioned, add db1065

https://gerrit.wikimedia.org/r/437769

Change 437769 merged by Jcrespo:
[operations/software@master] mariadb: Remove db1051, to be decommissioned, add db1065

https://gerrit.wikimedia.org/r/437769

jcrespo removed a project: Patch-For-Review.
jcrespo updated the task description. (Show Details)
jcrespo moved this task from Pending comment to In progress on the DBA board.
jcrespo added a subscriber: RobH.

Change 437779 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Decommission db1051

https://gerrit.wikimedia.org/r/437779

Change 437779 merged by Jcrespo:
[operations/puppet@production] mariadb: Decommission db1051

https://gerrit.wikimedia.org/r/437779

jcrespo updated the task description. (Show Details)

This is ready to be sent to robh, but waiting a week to make sure the replacements works as intended, and we don't need to revert/recover from the decommisioning one.

jcrespo moved this task from In progress to Done on the DBA board.
jcrespo added a project: decommission-hardware.

ready for decomm.

Vvjjkkii renamed this task from Decommission db1051 to 7ccaaaaaaa.Jul 1 2018, 1:08 AM
Vvjjkkii removed RobH as the assignee of this task.
Vvjjkkii raised the priority of this task from Medium to High.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed subscribers: gerritbot, Aklapper.
Marostegui renamed this task from 7ccaaaaaaa to Decommission db1051.Jul 1 2018, 6:55 PM
Marostegui assigned this task to Cmjohnson.
Marostegui lowered the priority of this task from High to Medium.
Marostegui updated the task description. (Show Details)

Change 445665 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] d1051 decom from repo

https://gerrit.wikimedia.org/r/445665

Change 445666 had a related patch set uploaded (by RobH; owner: RobH):
[operations/dns@master] decom db1051 prod dns

https://gerrit.wikimedia.org/r/445666

Change 445665 merged by RobH:
[operations/puppet@production] d1051 decom from repo

https://gerrit.wikimedia.org/r/445665

Change 445666 merged by RobH:
[operations/dns@master] decom db1051 prod dns

https://gerrit.wikimedia.org/r/445666

RobH removed a project: Patch-For-Review.
RobH updated the task description. (Show Details)
RobH moved this task from Backlog to pending onsite steps (eqiad) on the decommission-hardware board.

Change 451027 had a related patch set uploaded (by Cmjohnson; owner: Cmjohnson):
[operations/dns@master] removing mgmt dns for decom db hosts

https://gerrit.wikimedia.org/r/451027

Change 451027 merged by Cmjohnson:
[operations/dns@master] removing mgmt dns for decom db hosts

https://gerrit.wikimedia.org/r/451027

Cmjohnson updated the task description. (Show Details)