Please note these are due back for lease return December 2018. The decommission of these is high priority.
Once elastic2037-2054 (T210450) are configured, we can start removing those old servers. See [[ https://wikitech.wikimedia.org/wiki/Server_Lifecycle#Reclaim_to_Spares_OR_Decommission | Server Lifecycle ]] for details.
Steps:
* ban the servers from the cluster
* wait for all shards to relocate
* follow the steps in [[ https://wikitech.wikimedia.org/wiki/Server_Lifecycle#Reclaim_to_Spares_OR_Decommission | Server Lifecycle ]] (including adding a checklist for each server in this task).
=elastic2001=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2002=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2003=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2004=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2005=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2006=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2007=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2008=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2009=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2010=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2011=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2012=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2013=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2014=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2015=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2016=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2017=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2018=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2019=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2020=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2021=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2022=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2023=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.
=elastic2024=
== Decommission Checklist ==
[x] - all system services confirmed offline from production use
[x] - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
[x] - remove system from all lvs/pybal active configuration
[x] - any service group puppet/hiera/dsh config removed
[x] - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.)
START NON-INTERRUPPTABLE STEPS - please assign to @robh for the non-interrupt steps
[x] - disable puppet on host
[x] - power down host
[x] - update netbox status to Inventory (if decom) or Planned (if spare)
[x] - disable switch port
[x] - switch port assignment noted on this task (for later removal)
[x] - remove all remaining puppet references (include role::spare) https://gerrit.wikimedia.org/r/478105
[x] - remove production dns entries https://gerrit.wikimedia.org/r/478106
[x] - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
[x] - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)
END NON-INTERRUPPTABLE STEPS
[x] - system disks wiped (by onsite) - Please note these are SSD systems, and must be wiped using the hdparm utility.
[x] - system unracked and decommissioned (by onsite), update netbox with result
[x] - switch port configration removed from switch once system is unracked.
[] - add system to decommission tracking google sheet
[] - mgmt dns entries removed.
[] - update @robh when all elastic are done so we can move forward with lease return.