Aiming at starting the work on Wednesday 28th, 11am local time (6pm UTC), 5h estimated maintenance.
Before maintenance window:
[] Tentative: rack/power the routers in advance (temp location), to be able to upgrade them and apply initial config
[] Add routers to racktables (cr3-ulsfo & cr4-ulsfo)
[] Confirms valid backup or cr1/cr2 configs
[] Write down the unique serial # labeled on each fiber optic cable in each network port
[] Prepare DNS/Icinga/Smokeping/Rancid CR
During maintenance window:
[] Depool ulsfo from serving traffic via dns
[] Downtime all ulsfo hosts in Icinga/LibreNMS
[] Unplug all cr1 links
[] Unrack cr1-ulsfo
[] Move cr1 patch panel to other side of rack
[] Rack cr3-ulsfo
[] Connect cr3 uplinks (ports TBD)
[] Configure/upgrade cr3-ulsfo
[] Verify cr3 in healthy state (rollback decision)
[] Unplug all cr2 links
[] Unrack cr2-ulsfo
[] Move cr2 patch panel to other side of rack
[] Rack cr4-ulsfo
[] Connect cr4 uplinks (ports TBD)
[] Configure/upgrade cr4-ulsfo
[] Verify cr4 in healthy state
[] Merge Monitoring CR for cr3/4
[] Add cr3/4 to LibreNMS
[] Verify monitoring if happy
[] Re-pool ulsfo
After maintenance:
[] Cleanup mentions of cr1/2 in DNS, monitoring
[] Rename neighbor's interfaces descriptions
[] Update racktables
[] Wipe/unrack cr1/cr2