Maniphest T303733

Decommission ms-fe100[5-8]
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	MatthewVernon
	Mar 14 2022, 2:50 PM

Tags

Referenced Files

None

Subscribers

Description

ms-fe10[09-12] are now in service (cf T303698), so we can now decommission ms-fe100[5-8].

Details

	Subject	Repo	Branch	Lines +/-
	swift: remove ms-fe100[5-8]	operations/puppet	production	+2 -14

Customize query in gerrit

Related Objects

Mentioned Here: T304064: Decommission ms-fe100[5-8].eqiad.wmnet
T303698: Bring ms-fe10[09-12] into service

Event Timeline

MatthewVernon created this task.Mar 14 2022, 2:50 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 14 2022, 2:50 PM

Mentioned in SAL (#wikimedia-operations) [2022-03-16T14:25:13Z] <Emperor> depooling ms-fe100[5-8] prior to decommissioning T303733

Change 771360 had a related patch set uploaded (by MVernon; author: MVernon):

[operations/puppet@production] swift: remove ms-fe100[5-8]

https://gerrit.wikimedia.org/r/771360

gerritbot added a project: Patch-For-Review.Mar 16 2022, 2:30 PM

Change 771360 merged by MVernon:

[operations/puppet@production] swift: remove ms-fe100[5-8]

https://gerrit.wikimedia.org/r/771360

Mentioned in SAL (#wikimedia-operations) [2022-03-16T16:28:02Z] <Emperor> moving swiftrepl and stats reporter host from ms-fe1005 to ms-fe1009 T303733

Mentioned in SAL (#wikimedia-operations) [2022-03-16T16:36:59Z] <Emperor> rolling restart of ms-fe10[09-12] so they know about removal of older proxies T303733

Maintenance_bot removed a project: Patch-For-Review.Mar 16 2022, 5:10 PM

cookbooks.sre.hosts.decommission executed by mvernon@cumin1001 for hosts: ms-fe[1005-1008].eqiad.wmnet

ms-fe1005.eqiad.wmnet (PASS)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Downtimed management interface on Icinga/Alertmanager
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- Set Netbox status to Decommissioning and deleted all non-mgmt interfaces and related IPs
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB

ms-fe1006.eqiad.wmnet (PASS)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Downtimed management interface on Icinga/Alertmanager
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- Set Netbox status to Decommissioning and deleted all non-mgmt interfaces and related IPs
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB

ms-fe1007.eqiad.wmnet (PASS)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Downtimed management interface on Icinga/Alertmanager
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- Set Netbox status to Decommissioning and deleted all non-mgmt interfaces and related IPs
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB

ms-fe1008.eqiad.wmnet (PASS)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Downtimed management interface on Icinga/Alertmanager
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- Set Netbox status to Decommissioning and deleted all non-mgmt interfaces and related IPs
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB

This is now done, handed to DC team for decommissioning of hardware at T304064.