Page MenuHomePhabricator
Create Task
Maniphest T247018

codfw: decom at least 15 appservers in codfw rack C3 to make room for new servers
Closed, ResolvedPublic
Actions

Description

per T241852#5945821 15 new appservers in codfw can't be racked until at least 15 old servers have been removed.

Therefore rack C3 should have priority before other "decom old servers" tasks and we should start to take some out of there to make room.

Details

Show related patches Customize query in gerrit

Related Objects

Event Timeline

Dzahn created this task.Mar 5 2020, 7:20 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 5 2020, 7:20 PM
Dzahn mentioned this in T241852: (Need by: TBD) rack/setup/install 86 new codfw mw systems.Mar 5 2020, 7:23 PM
Papaul added a project: ops-codfw.Mar 5 2020, 7:23 PM
Papaul added a subscriber: Papaul.
Restricted Application added a project: SRE. · View Herald TranscriptMar 5 2020, 7:23 PM
Dzahn mentioned this in T247021: move all 86 new codfw appservers into production (mw2[291-2377].codfw.wmnet).Mar 5 2020, 7:30 PM
akosiaris triaged this task as High priority.Mar 6 2020, 11:30 AM
gerritbot added a comment.Mar 11 2020, 10:16 PM

Change 579073 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] decom 15 codfw appservers

https://gerrit.wikimedia.org/r/579073

gerritbot added a project: Patch-For-Review.Mar 11 2020, 10:16 PM
Stashbot added a comment.Mar 11 2020, 10:28 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-11T22:28:02Z] <mutante> depooled mw2167 through mw2172 - rack C3 (T247018)

Dzahn claimed this task.Mar 12 2020, 11:16 PM
Dzahn added a comment.Mar 12 2020, 11:48 PM

mw2158 through mw2172 are permanently depooled (state=inactive) now. That's exactly 15 servers from the middle of C3. Set them to status "decommissioning" in netbox.

Papaul renamed this task from decom at least 15 appservers in codfw rack C3 to make room for new servers to codfw: decom at least 15 appservers(mw2158 through mw2172) in codfw rack C3 to make room for new servers.Mar 12 2020, 11:53 PM
ops-monitoring-bot added a comment.Mar 13 2020, 12:04 AM

Icinga downtime for 12:00:00 set by dzahn@cumin1001 on 15 host(s) and their services with reason: decom

mw[2158-2172].codfw.wmnet
Dzahn added a comment.Mar 13 2020, 12:10 AM
In T247018#5966345, @Dzahn wrote:

mw2158 through mw2172 are permanently depooled (state=inactive) now. That's exactly 15 servers from the middle of C3. Set them to status "decommissioning" in netbox.

Reverted this. They are back in the pool for now because this got stalled for a week or 2, so why not keep using them for right now.

RobH moved this task from Backlog to Decommission on the ops-codfw board.Apr 1 2020, 5:46 PM
RobH added a project: decommission-hardware.
Dzahn changed the task status from Open to Stalled.Apr 3 2020, 9:38 AM
Dzahn changed the task status from Stalled to Open.May 21 2020, 11:42 AM
Stashbot added a comment.May 21 2020, 12:13 PM

Mentioned in SAL (#wikimedia-operations) [2020-05-21T12:13:19Z] <mutante> depooled mw2158 through mw2172 to make room again in C3 as planned (T247018)

gerritbot added a comment.May 21 2020, 12:57 PM

Change 597771 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: remove 13 old jobrunners from codfw rack C3

https://gerrit.wikimedia.org/r/597771

ops-monitoring-bot added a comment.May 21 2020, 3:09 PM

Icinga downtime for 4 days, 0:00:00 set by dzahn@cumin1001 on 15 host(s) and their services with reason: decom

mw[2158-2172].codfw.wmnet
gerritbot added a comment.May 22 2020, 9:38 AM

Change 597771 merged by Dzahn:
[operations/puppet@production] site: remove 13 old jobrunners from codfw rack C3

https://gerrit.wikimedia.org/r/597771

ops-monitoring-bot added a comment.May 22 2020, 9:43 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw2150.codfw.wmnet

  • mw2150.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.May 22 2020, 10:09 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2151-2155].codfw.wmnet

  • mw2151.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2152.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2153.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2154.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2155.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.May 22 2020, 10:34 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2156-2159].codfw.wmnet

  • mw2156.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2157.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2158.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2159.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.May 22 2020, 10:37 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2160-2162].codfw.wmnet

  • mw2160.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2161.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2162.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
Dzahn renamed this task from codfw: decom at least 15 appservers(mw2158 through mw2172) in codfw rack C3 to make room for new servers to codfw: decom at least 15 appservers in codfw rack C3 to make room for new servers.May 22 2020, 11:14 AM
Dzahn mentioned this in T242606: No mw canary servers in codfw.May 22 2020, 11:35 AM
gerritbot added a comment.May 22 2020, 11:48 AM

Change 598025 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: decom mw2163 through mw2169 appservers

https://gerrit.wikimedia.org/r/598025

gerritbot added a comment.May 22 2020, 12:00 PM

Change 598025 merged by Dzahn:
[operations/puppet@production] site: decom mw2163 through mw2169 appservers

https://gerrit.wikimedia.org/r/598025

ops-monitoring-bot added a comment.May 22 2020, 12:06 PM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2163-2166].codfw.wmnet

  • mw2163.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2164.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2165.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2166.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.May 22 2020, 12:13 PM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2167-2169].codfw.wmnet

  • mw2167.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2168.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2169.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
Dzahn added a comment.EditedMay 22 2020, 12:18 PM

@Papaul 23 servers from rack C3 have been decom'ed. mw2150 through mw2172. (lower part of the rack)

You can:

  • remove these physically from the rack
  • use the space for your planned test of new cabling schema
  • rack new servers in their place

Next week I am planning to remove even more so we might be able to empty out almost the entire C3.

gerritbot added a comment.May 22 2020, 12:48 PM

Change 598036 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: decom mw2170 - mw2172

https://gerrit.wikimedia.org/r/598036

gerritbot added a comment.May 22 2020, 1:00 PM

Change 598039 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] DHCP: remove recently decom'ed codfw appservers

https://gerrit.wikimedia.org/r/598039

gerritbot added a comment.May 22 2020, 1:04 PM

Change 598040 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] mcrouter: replace proxy in codfw row C

https://gerrit.wikimedia.org/r/598040

gerritbot added a comment.May 22 2020, 1:12 PM

Change 598040 merged by Dzahn:
[operations/puppet@production] mcrouter: replace proxy in codfw row C

https://gerrit.wikimedia.org/r/598040

gerritbot added a comment.May 22 2020, 2:20 PM

Change 598036 merged by Dzahn:
[operations/puppet@production] site: decom mw2170 - mw2172

https://gerrit.wikimedia.org/r/598036

ops-monitoring-bot added a comment.May 22 2020, 2:24 PM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2170-2172].codfw.wmnet

  • mw2170.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2171.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2172.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
gerritbot added a comment.May 22 2020, 2:31 PM

Change 598039 merged by Dzahn:
[operations/puppet@production] DHCP: remove recently decom'ed codfw appservers

https://gerrit.wikimedia.org/r/598039

Dzahn added a comment.May 22 2020, 2:39 PM

Technically resolved because we made more than enough room for the 5 (not 15 anymore, 10 were used for T252185) servers.

This unblocked T241852.

I'll keep it though to do more decoms next week and maybe clean all of C3 out so dcops can use it for new cabling.

Papaul added a comment.May 27 2020, 2:09 PM

@Dzahn Please to not resolve yet. I still have mgmt DNS and switch port to remove.

Thanks

gerritbot added a comment.May 29 2020, 6:08 AM

Change 599603 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: decom mw2173 through mw2179

https://gerrit.wikimedia.org/r/599603

gerritbot added a comment.May 29 2020, 6:12 AM

Change 599606 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: decom mw2180 through mw2186

https://gerrit.wikimedia.org/r/599606

gerritbot added a comment.May 29 2020, 6:13 AM

Change 579073 abandoned by Dzahn:
decom 15 codfw appservers from rack C3

Reason:
duplicate, already done in other changes

https://gerrit.wikimedia.org/r/579073

gerritbot added a comment.May 29 2020, 6:21 AM

Change 599610 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] remove production IPs of mw2163 through mw2172

https://gerrit.wikimedia.org/r/599610

gerritbot added a comment.May 29 2020, 6:24 AM

Change 599610 merged by Dzahn:
[operations/dns@master] remove production IPs of mw2163 through mw2172

https://gerrit.wikimedia.org/r/599610

gerritbot added a comment.May 29 2020, 6:28 AM

Change 599614 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] remove production IPs of mw2150 through mw2162

https://gerrit.wikimedia.org/r/599614

gerritbot added a comment.May 29 2020, 6:36 AM

Change 599614 merged by Dzahn:
[operations/dns@master] remove production IPs of mw2150 through mw2162

https://gerrit.wikimedia.org/r/599614

Dzahn added a comment.May 29 2020, 9:31 AM
In T247018#6169200, @Papaul wrote:

@Dzahn Please to not resolve yet. I still have mgmt DNS and switch port to remove.

@Papaul I also still had to remove production IPs. Done for mw2150 through mw2172.

Also uploaded new changes to decom mw2173 through mw2186 but they are not merged yet. Once they are this rack will be empty (of mw servers, minus the special cases that are not mw).

I see you started racking 4 of the new servers and made https://gerrit.wikimedia.org/r/c/operations/puppet/+/599749 for that (for now).

ops-monitoring-bot added a comment.Jun 2 2020, 1:37 PM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw2173.codfw.wmnet

  • mw2173.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.Jun 2 2020, 1:42 PM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2174-2177].codfw.wmnet

  • mw2174.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2175.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2176.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2177.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.Jun 2 2020, 1:45 PM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2178-2179].codfw.wmnet

  • mw2178.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2179.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
gerritbot added a comment.Jun 2 2020, 1:47 PM

Change 599603 merged by Dzahn:
[operations/puppet@production] site: decom mw2173 through mw2179

https://gerrit.wikimedia.org/r/599603

ops-monitoring-bot added a comment.Jun 3 2020, 7:48 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2180-2183].codfw.wmnet

  • mw2180.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2181.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2182.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2183.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
ops-monitoring-bot added a comment.Jun 3 2020, 7:52 AM

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: mw[2184-2186].codfw.wmnet

  • mw2184.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2185.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
  • mw2186.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found physical host
    • Downtimed management interface on Icinga
    • Wiped bootloaders
    • Powered off
    • Set Netbox status to Decommissioning
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
gerritbot added a comment.Jun 3 2020, 7:54 AM

Change 599606 merged by Dzahn:
[operations/puppet@production] site: decom mw2180 through mw2186

https://gerrit.wikimedia.org/r/599606

gerritbot added a comment.Jun 3 2020, 8:01 AM

Change 602012 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] remove production IPs for mw2173 through mw2186

https://gerrit.wikimedia.org/r/602012

gerritbot added a comment.Jun 3 2020, 8:05 AM

Change 602012 merged by Dzahn:
[operations/dns@master] remove production IPs for mw2173 through mw2186

https://gerrit.wikimedia.org/r/602012

gerritbot added a comment.Jun 3 2020, 8:09 AM

Change 602013 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] remove mgmt IPs for mw2150 through mw2186

https://gerrit.wikimedia.org/r/602013

Dzahn added a comment.Jun 3 2020, 8:14 AM

@Papaul All remaining old mw servers in rack C3 (mw2154 through mw2186) are also decom'ed now. Removed from site, production IPs removed, only pending removing mgmt IPs (https://gerrit.wikimedia.org/r/c/operations/dns/+/602013).

You can feel free to remove and replace them with new servers and use C3 for new cabling (except the thumbor/db servers). Let me know when we are ready to merge the change above to remove mgmt IPs as well.

I am assigning to you for now because you said "don't resolve yet, i still have switch ports to do" etc. Please assign back to me once that is done.

Dzahn reassigned this task from Dzahn to Papaul.Jun 3 2020, 8:14 AM
Dzahn lowered the priority of this task from High to Medium.
Dzahn mentioned this in T251570: codfw: Next Gen test rack.Jun 3 2020, 8:23 AM
Papaul added a comment.Jun 8 2020, 10:20 PM

switch ports removed for mw2154 through mw2186

Dzahn added a comment.Jun 9 2020, 7:19 AM
In T247018#6204125, @Papaul wrote:

switch ports removed for mw2154 through mw2186

@Papaul Thanks! Does that mean https://gerrit.wikimedia.org/r/c/operations/dns/+/602013 can be merged?

Papaul added a comment.Jun 9 2020, 5:01 PM

@Dzahn yes you can merge that.

Thabks

gerritbot added a comment.Jun 10 2020, 8:07 AM

Change 602013 merged by Dzahn:
[operations/dns@master] remove mgmt IPs for mw2150 through mw2186

https://gerrit.wikimedia.org/r/602013

Dzahn added a comment.Jun 10 2020, 8:08 AM

@Papaul done! Do you still have anything to do here on your side?

Maintenance_bot removed a project: Patch-For-Review.Jun 10 2020, 8:10 AM
Papaul added a comment.Jun 10 2020, 4:08 PM

@Dzahn yes i have to setup all the decom servers to offline

Papaul closed this task as Resolved.Jun 10 2020, 7:45 PM

Complete

Dzahn awarded a token.Jun 12 2020, 9:59 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL