Page MenuHomePhabricator

Eqiad C/D refresh: move asw2-d-eqiad CR uplinks to Nokia switches
Closed, ResolvedPublic

Description

High-level task to document the migration on our core routers in eqiad of the links running from asw2-d-eqiad to our core routers. Specifically these links:

ASW Side (not moving)Currently connected toNeeds to move to
asw2-d2-eqiad et-2/0/49cr1-eqiad et-1/1/3ssw1-d1-eqiad ethernet-1/29
asw2-d7-eqiad et-7/0/53cr2-eqiad et-1/1/3ssw1-d8-eqiad ethernet-1/29

Once migrated traffic will flow, instead of directly from core routers to the asw2-d-eqiad virtual-chassis, via our new Nokia Spine switches (already connected to the core routers on et-1/0/5 respectively) and then to the old Junipers. This will extend the vlans for row D to the Nokia switches which will allow us to move forward and start migrating server connections to them.

Vlans

The following vlans/sub-interfaces are affected:

cmooney@re0.cr1-eqiad> show interfaces descriptions | match ae4   
ae4             up    up   asw2-d-eqiad:ae1
ae4.1004        up    up   Subnet public1-d-eqiad
ae4.1020        up    up   Subnet private1-d-eqiad
ae4.1023        up    up   Subnet analytics1-d-eqiad

Process

The process will follow the steps outlined for row C in T405579

Event Timeline

cmooney triaged this task as Medium priority.

Icinga downtime and Alertmanager silence (ID=a04c020e-81be-4ee8-bf2f-5bcc8830a8da) set by cmooney@cumin1003 for 2:00:00 on 3 host(s) and their services with reason: moving uplinks from CRs to Nokia Spines on asw2-d-eqiad

asw2-d-eqiad,cr[1-2]-eqiad

Mentioned in SAL (#wikimedia-operations) [2025-11-03T13:56:19Z] <topranks> shut down cr1-eqiad link to asw2-d-eqiad to migrate traffic via Nokia spines T409067

Mentioned in SAL (#wikimedia-operations) [2025-11-03T14:39:11Z] <topranks> enable cr1-eqiad sub-interfaces for row D vlans T409067

Mentioned in SAL (#wikimedia-operations) [2025-11-03T14:48:24Z] <topranks> make cr1-eqiad VRRP primary for row D vlans T409067

Mentioned in SAL (#wikimedia-operations) [2025-11-03T14:56:42Z] <topranks> disable et-1/1/3 on cr2-eqiad connecting to asw2-d-eqiad T409067

Mentioned in SAL (#wikimedia-operations) [2025-11-03T15:05:13Z] <topranks> enable link from asw2-d7-eqiad to ssw1-d8-eqiad T409067

Mentioned in SAL (#wikimedia-operations) [2025-11-03T16:22:01Z] <topranks> enable row D vlan sub-interfaces on cr2-eqiad et-1/0/5 T409067

Mentioned in SAL (#wikimedia-operations) [2025-11-03T16:27:46Z] <topranks> make cr2-eqiad active for row D vlan sub-interfaces on et-1/0/5 T409067

Change #1201101 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/homer/public@master] eqiad row d: migrate CR gateway interfaces to port et-1/0/5

https://gerrit.wikimedia.org/r/1201101

Uplinks moved, the actual gateway move from CR to switches we will wait until Nokia have resolved our open issues/bug reports.

Change #1201101 merged by jenkins-bot:

[operations/homer/public@master] eqiad row d: migrate CR gateway interfaces to port et-1/0/5

https://gerrit.wikimedia.org/r/1201101