Maniphest T342035

Decommission wdqs200[4-6]
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Gehel
	Jul 17 2023, 6:38 PM

Tags

Referenced Files

None

Subscribers

Description

Once T332314 is completed, older WDQS servers can be decommissioned.

Hosts that need to be decom'd (sourced from T326689):
wdqs200[4-6]

wdqs201[3-5] will replace wdqs200[4-6]. wdqs20[16-22] will be net-new hosts.

AC:

decommission cookbook has been ran
ticket is created for DC-Ops to reclaim the servers => T342600

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	decom wdqs200[4-6]	operations/puppet	production	+0 -14

Customize query in gerrit

Related Objects

Mentioned In: T332314: Service implementation for wdqs20[13-22]
Mentioned Here: T342600: decommission wdqs200[4-6]
T326689: Q3:rack/setup/install wdqs20[13-22]
T332314: Service implementation for wdqs20[13-22]

Event Timeline

Gehel created this task.Jul 17 2023, 6:38 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 17 2023, 6:38 PM

Gehel mentioned this in T332314: Service implementation for wdqs20[13-22].Jul 17 2023, 6:38 PM

RKemper updated the task description. (Show Details)Jul 17 2023, 6:39 PM

With the new hosts in service, we can now begin decom'ing these hosts at our convenience.

RKemper renamed this task from Decommission old WDQS servers to Decommission wdqs200[4-6].Jul 24 2023, 11:30 PM

RKemper updated the task description. (Show Details)

RKemper updated the task description. (Show Details)Jul 25 2023, 2:54 AM

Change 941037 had a related patch set uploaded (by Ryan Kemper; author: Ryan Kemper):

[operations/puppet@production] decom wdqs200[4-6]

https://gerrit.wikimedia.org/r/941037

gerritbot added a project: Patch-For-Review.Jul 25 2023, 4:44 AM

Change 941037 merged by Ryan Kemper:

[operations/puppet@production] decom wdqs200[4-6]

https://gerrit.wikimedia.org/r/941037

Maintenance_bot removed a project: Patch-For-Review.Jul 25 2023, 5:10 AM

RKemper updated the task description. (Show Details)Jul 25 2023, 5:33 AM

cookbooks.sre.hosts.decommission executed by ryankemper@cumin1001 for hosts: wdqs[2004-2006].codfw.wmnet

wdqs2004.codfw.wmnet (WARN)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Management interface not found on Icinga, unable to downtime it
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
- Configured the linked switch interface(s)
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB

wdqs2005.codfw.wmnet (WARN)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Management interface not found on Icinga, unable to downtime it
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
- Configured the linked switch interface(s)
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB

wdqs2006.codfw.wmnet (WARN)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Management interface not found on Icinga, unable to downtime it
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
- Configured the linked switch interface(s)
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB

Decom cookbook finished, and dc-ops ticket created (see ticket desc AC section for ticket #)

Gehel closed this task as Resolved.Aug 4 2023, 9:39 AM