Page MenuHomePhabricator

Decommission asw-a-eqiad
Closed, ResolvedPublic

Description

  • Verify no more traffic on asw-a-eqiad <->asw2-a-eqiad link [Arzhel]
  • Disable asw-a-eqiad <->asw2-a-eqiad [Arzhel]
  • Remove from monitoring (LibreNMS/Rancid/Smokeping/Icinga) [Arzhel]
  • Unplug asw-a-eqiad <->asw2-a-eqiad links [Chris]
  • Cleanup interfaces config on asw2-a-eqiad [Chris/Arzhel]
  • Wipe and power down device [DCops/Arzhel]
  • Unplug mgmt/console port and remove from DNS [Chris]
  • Update console servers [Chris]
  • Unrack asw-a-eqiad members [Chris]
  • Update Netbox

Event Timeline

ayounsi triaged this task as Medium priority.Mar 19 2019, 8:01 PM
ayounsi created this task.

Change 497601 had a related patch set uploaded (by Ayounsi; owner: Ayounsi):
[operations/puppet@production] Remove asw-a-eqiad from monitoring

https://gerrit.wikimedia.org/r/497601

Change 497601 merged by Ayounsi:
[operations/puppet@production] Remove asw-a-eqiad from monitoring

https://gerrit.wikimedia.org/r/497601

Change 497606 had a related patch set uploaded (by Ayounsi; owner: Ayounsi):
[operations/puppet@production] Icinga: re-add asw-a-eqiad

https://gerrit.wikimedia.org/r/497606

Change 497606 abandoned by Ayounsi:
Icinga: re-add asw-a-eqiad

Reason:
not needed

https://gerrit.wikimedia.org/r/497606

@Jclark-ctr Please make sure all of these switches have been restored to factory defaults, unplug, and remove the racks. Please be very careful not to unplug anything else. There is a lot going on back there. Once off the racks please pull all the old stacking cables.

remove from racks and preformed factory reset

When making an unrelated change in DNS I got an unexpected diff, the removal of asw-a-eqiad.mgmt.eqiad.wmnet, which made me hesitate.

I asked around to make sure it's ok and eventually merged the diff.

When deleting IPs from netbox someone also needs to run the DNS cookbook to actually apply the change on DNS servers but a problem might be lack of shell access/ privileges for that.

@Dzahn, I think that was a case of, he didn't realize mgmt addresses were
still associated with the old network gear. Thanks for the heads up