db2042 can be decommissioned

db2042

Decommission Checklist

• - all system services confirmed offline from production use - should be done by DBA team
• - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
• - remove system from all lvs/pybal active configuration - should be done by DBA team:
• - any service group puppet/heira/dsh config removed - should be done by DBA team
• - remove site.pp (replace with role(spare::system) if system isn't shut down immediately during this process.) - should be done by DBA team: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/514646/

START NON-INTERRUPPTABLE STEPS - please assign to @RobH for the non-interrupt steps

• - disable puppet on host
• - power down host
• - update status in netbox (inventory for decom, planned for spare)
• - disable switch port
• - switch port assignment noted on this task (for later removal) : asw-d-codfw:ge-3/0/10
• - remove all remaining puppet references (include role::spare)
• - remove production dns entries
• - puppet node clean, puppet node deactivate (handled by wmf-decommission-host)
• - remove dbmonitor entries on neodymium/sarin: sudo curl -X DELETE https://debmonitor.discovery.wmnet/hosts/${HOST_FQDN} --cert /etc/debmonitor/ssl/cert.pem --key /etc/debmonitor/ssl/server.key (handled by wmf-decommission-host)

END NON-INTERRUPPTABLE STEPS

• - system disks wiped (by onsite) use hdparm for ssds and wipe for hdds
• - label BBU as broken so it doesn't get re-used T214264
• -system unracked and decommissioned (by onsite), update status in netbox to offline
• -switch port configration removed from switch once system is unracked.
• - add system to decommission tracking google sheet
• - mgmt dns entries removed.