Page MenuHomePhabricator
Create Task
Maniphest T184054

Decommission db1029 and db1031
Closed, ResolvedPublic
Actions

Description

Hosts to retire:

  • db1029
  • db1031
  • Ops steps
  • DC ops
    • Disable puppet on host
    • Remove all remaining puppet references (include role::spare:system)
    • Power down host
    • Disable switch port
    • Switch port assignment noted on this task (for later removal)
    • Remove production dns entries
    • Puppet node clean, puppet node deactivate
  • Decommission
    • System disks wiped (by onsite)
    • System unracked and decommissioned (by onsite), update racktables with result
    • Switch port configration removed from switch once system is unracked.
    • Mgmt dns entries removed.

Details

SubjectRepoBranchLines +/-
decommission db1029 and db1030operations/puppetproduction+0 -22
mariadb: Decommission db1031operations/puppetproduction+4 -4
mariadb: Remove references to db1031operations/softwaremaster+0 -1
mariadb: Point x1-master.eqiad.wmnet to db1055operations/dnsmaster+1 -1
mariadb: Point x1-slave.eqiad.wmnet to db1056operations/dnsmaster+1 -1
mariadb: Set db1029 as a spare and ready to decommissionoperations/puppetproduction+5 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

jcrespo triaged this task as Medium priority.Jan 3 2018, 10:21 AM
jcrespo created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 3 2018, 10:21 AM
gerritbot subscribed.Jan 3 2018, 10:22 AM

Change 401708 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Set db1029 as a spare and ready to decommission

https://gerrit.wikimedia.org/r/401708

gerritbot added a project: Patch-For-Review.Jan 3 2018, 10:22 AM
gerritbot added a comment.Jan 3 2018, 10:33 AM

Change 401711 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/dns@master] mariadb: Point x1-slave.eqiad.wmnet to db1056

https://gerrit.wikimedia.org/r/401711

gerritbot added a comment.Jan 3 2018, 10:33 AM

Change 401712 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/dns@master] mariadb: Point x1-master.eqiad.wmnet to db1055

https://gerrit.wikimedia.org/r/401712

Marostegui moved this task from Triage to In progress on the DBA board.Jan 3 2018, 10:37 AM
gerritbot added a comment.Jan 3 2018, 10:39 AM

Change 401708 merged by Jcrespo:
[operations/puppet@production] mariadb: Set db1029 as a spare and ready to decommission

https://gerrit.wikimedia.org/r/401708

gerritbot added a comment.Jan 3 2018, 10:48 AM

Change 401711 merged by Jcrespo:
[operations/dns@master] mariadb: Point x1-slave.eqiad.wmnet to db1056

https://gerrit.wikimedia.org/r/401711

gerritbot added a comment.Jan 16 2018, 9:02 AM

Change 401712 merged by Jcrespo:
[operations/dns@master] mariadb: Point x1-master.eqiad.wmnet to db1055

https://gerrit.wikimedia.org/r/401712

jcrespo claimed this task.Jan 16 2018, 9:05 AM
jcrespo updated the task description. (Show Details)

We will wait some days before going on, to make sure the new masters work as intended/no errors/no data loss.

gerritbot added a comment.Jan 19 2018, 11:50 AM

Change 405276 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software@master] mariadb: Remove references to db1031

https://gerrit.wikimedia.org/r/405276

jcrespo updated the task description. (Show Details)Jan 19 2018, 11:53 AM
gerritbot added a comment.Jan 19 2018, 12:09 PM

Change 405278 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Decommission db1031

https://gerrit.wikimedia.org/r/405278

gerritbot added a comment.Jan 19 2018, 12:13 PM

Change 405276 merged by Jcrespo:
[operations/software@master] mariadb: Remove references to db1031

https://gerrit.wikimedia.org/r/405276

gerritbot added a comment.Jan 19 2018, 12:14 PM

Change 405278 merged by Jcrespo:
[operations/puppet@production] mariadb: Decommission db1031

https://gerrit.wikimedia.org/r/405278

jcrespo edited projects, added ops-eqiad; removed Patch-For-Review.Jan 19 2018, 12:26 PM
jcrespo updated the task description. (Show Details)
Restricted Application added a project: SRE. · View Herald TranscriptJan 19 2018, 12:26 PM
jcrespo reassigned this task from jcrespo to • Cmjohnson.EditedJan 19 2018, 12:30 PM
jcrespo moved this task from In progress to Blocked external/Not db team on the DBA board.

Chris, these 2 are ready to be unracked or whatever it is its end of life (after being wiped).

Marostegui moved this task from Blocked external/Not db team to Done on the DBA board.Jan 19 2018, 4:21 PM
jcrespo merged a task: T166108: x1 master db1031: Faulty BBU.Jan 19 2018, 5:51 PM
jcrespo added subscribers: Stashbot, Addshore.
jcrespo added a project: hardware-requests.Jan 19 2018, 6:20 PM
• Cmjohnson moved this task from Backlog to Decommission on the ops-eqiad board.Jan 26 2018, 7:10 PM
RobH moved this task from Backlog to Reclaim (Spares/Decommission) on the hardware-requests board.Feb 1 2018, 6:06 PM
RobH claimed this task.Feb 9 2018, 10:28 PM
RobH added a subscriber: • Cmjohnson.
Marostegui added a parent task: T134476: Decommission old coredb machines (<=db1050).Mar 23 2018, 4:42 PM
Addshore unsubscribed.Mar 23 2018, 4:42 PM
Marostegui mentioned this in T191792: Rack and setup db1116 - db1123.Apr 9 2018, 1:20 PM
gerritbot added a comment.Apr 24 2018, 8:53 PM

Change 428829 had a related patch set uploaded (by Cmjohnson; owner: Cmjohnson):
[operations/puppet@production] decommission db1029 and db1030

https://gerrit.wikimedia.org/r/428829

gerritbot added a project: Patch-For-Review.Apr 24 2018, 8:53 PM
gerritbot added a comment.Apr 24 2018, 8:56 PM

Change 428829 merged by Cmjohnson:
[operations/puppet@production] decommission db1029 and db1030

https://gerrit.wikimedia.org/r/428829

• Cmjohnson moved this task from Decommission to High Priority Task on the ops-eqiad board.Apr 24 2018, 9:30 PM
• Cmjohnson moved this task from High Priority Task to Up next on the ops-eqiad board.
• Cmjohnson updated the task description. (Show Details)
RobH edited projects, added decommission-hardware; removed Patch-For-Review, hardware-requests.May 3 2018, 10:58 PM
• Cmjohnson updated the task description. (Show Details)May 7 2018, 5:46 PM
• Cmjohnson moved this task from Up next to High Priority Task on the ops-eqiad board.
Marostegui reassigned this task from RobH to • Cmjohnson.May 14 2018, 6:24 AM
Marostegui added a subscriber: RobH.

Assigning it to Chris to reflect current status

Marostegui moved this task from Backlog to pending onsite steps (eqiad) on the decommission-hardware board.Jun 14 2018, 6:26 AM
• Cmjohnson closed this task as Resolved.Jun 26 2018, 4:44 PM
• Cmjohnson updated the task description. (Show Details)
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL