Page MenuHomePhabricator

replace msw[12]-ulsfo with new switches
Closed, ResolvedPublic

Description

This task tracks the replacement of our netgear msw switches in ulsfo with new switches (lifetime warranty).

This is mgmt, so downtime is not a big deal for mgmt in our caching sites as long as its not during planned maintainance.

Per host setup checklist

Each host should have its own setup checklist copied and pasted into the list below.

new-msw1-ulsfo:

  • - receive in system on procurement task T251549
  • - add new switch as 'new-msw1-ulsfo' in netbox. This name will change/remove the 'new-' once the old switch is unracked and its hostname set to its asset tag.
  • - clear downtime of mgmt (approximately 30 minutes per rack) with netops and Traffic
  • - power down and remove the old switch from the rack, rack new switch in its place.
  • - change old switch hostname to asset tag, screen shot the port layout and replicate it on the new switch
  • - update netbox for the new switch, listing each connection on the cable mappings.
  • - test ping all mgmt devices to ensure connectivity is restored.

new-msw2-ulsfo:

  • - receive in system on procurement task T251549
  • - add new switch as 'new-msw2-ulsfo' in netbox. This name will change/remove the 'new-' once the old switch is unracked and its hostname set to its asset tag.
  • - clear downtime of mgmt (approximately 30 minutes per rack) with netops and Traffic
  • - power down and remove the old switch from the rack, rack new switch in its place.
  • - change old switch hostname to asset tag, screen shot the port layout and replicate it on the new switch
  • - update netbox for the new switch, listing each connection on the cable mappings.
  • - test ping all mgmt devices to ensure connectivity is restored.

Once the system(s) above have had all checkbox steps completed, this task can be resolved.

Related Objects

StatusSubtypeAssignedTask
ResolvedRobH

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
RobH added a parent task: Unknown Object (Task).Jun 24 2020, 6:42 PM
RobH mentioned this in Unknown Object (Task).Jun 24 2020, 7:21 PM
RobH moved this task from Backlog to Racking Tasks on the ops-ulsfo board.

Mentioned in SAL (#wikimedia-operations) [2020-06-26T17:52:56Z] <robh> msw2-ulsfo work done, all mgmt items confirmed back online and icinga alerts cleared, moving onto msw1-ulsfo (rack 22) and will lose all mgmt in that rack for next 10-20 minutes T256300

RobH updated the task description. (Show Details)

Ok the old switches are unracked and in the bottom of rack 23. all cables in netbox added and all duplicate cable id conflicts resolved/fixed.