Once we've completed T352912 we can move on to move lvs2011 from the legacy per-row vlan private1-a-codfw to the rack-specific one private1-a2-codfw.
This will also change the host from BGP peering with the two codfw core routers to the Leaf switch in rack A2.
The (updated) process will be roughly:
- Netbox: Reserve new IPs from private1-a2-codfw for lvs2011
- Puppet: Create patch that will (don't merge yet):
- Move previous primary IP to new vlan sub-interface of primary link
- Change the BGP peering for Pybal on the host to peer with the top-of-rack not CRs
- Add the newly-assigned primary IP to hierdata/common.yaml
- Downtime lvs2011, CRs and lsw1-a2-codfw
- Disable puppet on lvs2011
- Manually stop PyBal service on lvs2011
- Check grafana traffic graphs / connections to validate that traffic has moved to using backup lvs2014 and everything looking ok after 15-20 mins
- Netbox:
- Attach reserved IPs to primary interface of lvs, removing old ones
- Change untagged vlan for switch port from old to new vlan
- Add old vlan to list of tagged vlans on switch port
- Homer: Push new switch config
- lvs will now be unreachable via SSH - use idrac console if needed
- Run sre.dns.netbox cookbook to update primary DNS for lvs2011
- Run sre.dns.wipe-cache cookbook for lvs2011
- Manually disable BGP peering to lvs on lsw1-a2-codfw
- Merge patch created in step 2
- Start reimage of lvs2011
- Homer: run against CRs to remove old BGP peering
- When host re-imaged it shoould come back up on the new primary IP
- Check reachability is ok over new primary IP (v4/v6)
- Check reachbility is ok to old private1-a-codfw vlan (v4-v6)
- Manually enable BGP peering to lvs on lsw1-a2-codfw
- Check BGP establishes, watch grafana connection graphs to see traffic flip back from lvs2014, test connections