Page MenuHomePhabricator
Create Task
Maniphest T187445

Decommission osm-db200[12] and osm-web200[1234]
Closed, ResolvedPublic
Actions

Description

Should be empty, also see T182033 and T182034.

This task will track the decommission-hardware of servers: osm-db200[12] & osm-cp200[1-4]. Please note NONE of these systems were installed, and do NOT have an OS on them. We cannot confirm they were properly wiped from their previous OS though, so they do need to have their disks wiped.

There is no puppet to stop, they are not in puppetdb or monitoring, so this is a modified checklist.

The first 5 steps should be completed by the service owner that is returning the server to DC-ops (for reclaim to spare or decommissioning, dependent on server configuration and age.)

osm-db2001:

  • - systems never deployed, no icinga, no monitoring, nothing to remove in puppet repo, no production dns entires.

Steps for DC-Ops:

  • - update netbox status to Inventory (if decom)
  • - disable switch port - no switch port assigned on switch labels to disable
  • - switch port assignment noted on this task (for later removal) - no switch port assigned on switch labels to disable
  • - remove all remaining puppet references (include role::spare)
  • - remove production dns entries
  • - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
  • - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)

End non-interrupt steps.

  • - system disks wiped (by onsite)
  • - IF DECOM: system unracked and decommissioned (by onsite), update Netbox with result
  • - IF DECOM: switch port configration removed from switch once system is unracked.
  • - IF DECOM: add system to decommission tracking google sheet
  • - IF DECOM: mgmt dns entries removed.
  • - change netbox status to offline when unracked

osm-db2002:

  • - systems never deployed, no icinga, no monitoring, nothing to remove in puppet repo, no production dns entires.

Steps for DC-Ops:

  • - update netbox status to Inventory (if decom)
  • - disable switch port - no switch port assigned on switch labels to disable
  • - switch port assignment noted on this task (for later removal) - no switch port assigned on switch labels to disable
  • - remove all remaining puppet references (include role::spare)
  • - remove production dns entries
  • - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
  • - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)

End non-interrupt steps.

  • - system disks wiped (by onsite)
  • - IF DECOM: system unracked and decommissioned (by onsite), update Netbox with result
  • - IF DECOM: switch port configration removed from switch once system is unracked.
  • - IF DECOM: add system to decommission tracking google sheet
  • - IF DECOM: mgmt dns entries removed.
  • - change netbox status to offline when unracked

osm-web2001:

  • - systems never deployed, no icinga, no monitoring, nothing to remove in puppet repo, no production dns entires.

Steps for DC-Ops:

  • - update netbox status to Inventory (if decom)
  • - disable switch port - no switch port assigned on switch labels to disable
  • - switch port assignment noted on this task (for later removal) - no switch port assigned on switch labels to disable
  • - remove all remaining puppet references (include role::spare)
  • - remove production dns entries
  • - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
  • - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)

End non-interrupt steps.

  • - system disks wiped (by onsite)
  • - IF DECOM: system unracked and decommissioned (by onsite), update racktables with result
  • - IF DECOM: switch port configration removed from switch once system is unracked.
  • - IF DECOM: add system to decommission tracking google sheet
  • - IF DECOM: mgmt dns entries removed.
  • - change netbox status to offline when unracked

osm-web2002:

  • - systems never deployed, no icinga, no monitoring, nothing to remove in puppet repo, no production dns entires.

Steps for DC-Ops:

  • - update netbox status to Inventory (if decom)
  • - disable switch port - no switch port assigned on switch labels to disable
  • - switch port assignment noted on this task (for later removal) - no switch port assigned on switch labels to disable
  • - remove all remaining puppet references (include role::spare)
  • - remove production dns entries
  • - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
  • - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)

End non-interrupt steps.

  • - system disks wiped (by onsite)
  • - IF DECOM: system unracked and decommissioned (by onsite), update racktables with result
  • - IF DECOM: switch port configration removed from switch once system is unracked.
  • - IF DECOM: add system to decommission tracking google sheet
  • - IF DECOM: mgmt dns entries removed.
  • - change netbox status to offline when unracked

osm-web2003:

  • - systems never deployed, no icinga, no monitoring, nothing to remove in puppet repo, no production dns entires.

Steps for DC-Ops:

  • - update netbox status to Inventory (if decom)
  • - disable switch port - no switch port assigned on switch labels to disable
  • - switch port assignment noted on this task (for later removal) - no switch port assigned on switch labels to disable
  • - remove all remaining puppet references (include role::spare)
  • - remove production dns entries
  • - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
  • - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)

End non-interrupt steps.

  • - system disks wiped (by onsite)
  • - IF DECOM: system unracked and decommissioned (by onsite), update racktables with result
  • - IF DECOM: switch port configration removed from switch once system is unracked.
  • - IF DECOM: add system to decommission tracking google sheet
  • - IF DECOM: mgmt dns entries removed.
  • - change netbox status to offline when unracked

osm-web2004:

  • - systems never deployed, no icinga, no monitoring, nothing to remove in puppet repo, no production dns entires.

Steps for DC-Ops:

  • - update netbox status to Inventory (if decom)
  • - disable switch port - no switch port assigned on switch labels to disable
  • - switch port assignment noted on this task (for later removal) - no switch port assigned on switch labels to disable
  • - remove all remaining puppet references (include role::spare)
  • - remove production dns entries
  • - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
  • - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)

End non-interrupt steps.

  • - system disks wiped (by onsite)
  • - IF DECOM: system unracked and decommissioned (by onsite), update racktables with result
  • - IF DECOM: switch port configration removed from switch once system is unracked.
  • - IF DECOM: add system to decommission tracking google sheet
  • - IF DECOM: mgmt dns entries removed.
  • - change netbox status to offline when unracked

Details

SubjectRepoBranchLines +/-
DNS: Remove mgmt DNS for osm-db200[12] and osm-web200[1234]operations/dnsmaster+1 -24
DNS: Remove mgmt DNS for osm-db200[12] and osm-web200[1234]operations/dnsmaster+1 -4 K
Customize query in gerrit

Related Objects

Event Timeline

faidon triaged this task as Low priority.Feb 15 2018, 1:56 PM
faidon created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 15 2018, 1:56 PM
RobH moved this task from Backlog to Decommission on the ops-codfw board.Mar 15 2018, 5:13 PM
• Phabricator_maintenance moved this task from Backlog to Acknowledged on the SRE board.Jan 26 2019, 9:47 PM
RobH assigned this task to Papaul.Apr 18 2019, 8:59 PM
RobH raised the priority of this task from Low to Medium.
RobH updated the task description. (Show Details)
RobH added a project: decommission-hardware.
RobH moved this task from Backlog to pending onsite steps (codfw) on the decommission-hardware board.
RobH updated the task description. (Show Details)Apr 25 2019, 11:54 PM
Papaul added a comment.Apr 29 2019, 3:36 PM

osm-db2001

papaul@asw-a-codfw> show interfaces ge-5/0/2 descriptions    
Interface       Admin Link Description
ge-5/0/2        down  down DISABLED

osm-db2002

papaul@asw-b-codfw> show interfaces ge-5/0/2 descriptions 
Interface       Admin Link Description
ge-5/0/2        down  down DISABLED

osm-web2001

papaul@asw-a-codfw# run show interfaces ge-5/0/10 descriptions 
Interface       Admin Link Description
ge-5/0/10       down  down DISABLED

osm-web2002

papaul@asw-b-codfw> show interfaces ge-5/0/10 descriptions   
Interface       Admin Link Description
ge-5/0/10       down  down DISABLED

osm-web2003

papaul@asw-a-codfw> show interfaces ge-5/0/7 descriptions     
Interface       Admin Link Description
ge-5/0/7        down  down DISABLED

osm-web2004

papaul@asw-b-codfw> show interfaces ge-5/0/7 descriptions     
Interface       Admin Link Description
ge-5/0/7        down  down DISABLED
Papaul updated the task description. (Show Details)Apr 29 2019, 3:37 PM
Papaul updated the task description. (Show Details)Apr 30 2019, 7:53 PM
Papaul updated the task description. (Show Details)Apr 30 2019, 7:59 PM
Papaul updated the task description. (Show Details)May 1 2019, 2:40 PM
gerritbot added a comment.May 7 2019, 11:18 PM

Change 508738 had a related patch set uploaded (by Papaul; owner: Papaul):
[operations/dns@master] DNS: Remove mgmt DNS for osm-db200[12] and osm-web200[1234]

https://gerrit.wikimedia.org/r/508738

gerritbot added a project: Patch-For-Review.May 7 2019, 11:19 PM
gerritbot added a comment.May 7 2019, 11:23 PM

Change 508738 abandoned by Papaul:
DNS: Remove mgmt DNS for osm-db200[12] and osm-web200[1234]

Reason:
mistake

https://gerrit.wikimedia.org/r/508738

gerritbot added a comment.May 8 2019, 1:41 PM

Change 508823 had a related patch set uploaded (by Papaul; owner: Papaul):
[operations/dns@master] DNS: Remove mgmt DNS for osm-db200[12] and osm-web200[1234]

https://gerrit.wikimedia.org/r/508823

gerritbot added a comment.May 8 2019, 5:15 PM

Change 508823 merged by Dzahn:
[operations/dns@master] DNS: Remove mgmt DNS for osm-db200[12] and osm-web200[1234]

https://gerrit.wikimedia.org/r/508823

Dzahn updated the task description. (Show Details)May 8 2019, 5:16 PM
Papaul closed this task as Resolved.May 8 2019, 6:51 PM

Complete

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL