This task will track the decommission-hardware of servers mc20[19-27].codfw.wmnet and mc20[29-37].codfw.wmnet
mc2028 died in 2020: T261168
2019.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2020.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2021.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2022.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2023.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2024.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2025.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2026.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2027.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2029.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2030.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2031.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2032.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2033.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2034.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2035.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2036.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag
2037.codfw.net
Steps for service owner:
- - all system services confirmed offline from production use
- - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place. (likely done byscript)
- - remove system from all lvs/pybal active configuration
- - any service group puppet/hiera/dsh config removed
- - remove site.pp, replace with role(spare::system) recommended to ensure services offline but not 100%required as long as the decom script is IMMEDIATELY run below.
- - login to cumin host and run the decom cookbook: cookbook sre.hosts.decommission <host fqdn> -t <phab task>. This does: bootloader wipe, host power down, netbox update to decommissioning status, puppet node clean, puppet node deactivate, debmonitor removal, and run homer.
- - remove all remaining puppet references and all host entries in the puppet repo
- - reassign task from service owner to DC ops team member and site project (ops-sitename) depending on site of server
End service owner steps / Begin DC-Ops team steps:
- - system disks removed (by onsite)
- - determine system age, under 5 years are reclaimed to spare, over 5 years are decommissioned.
- - IF DECOM: system unracked and decommissioned (by onsite), update netbox with result and set state to offline
- - IF DECOM: mgmt dns entries removed.
- - IF RECLAIM: set netbox state to 'inventory' and hostname to asset tag