[x] Figure out who is going to do the onsite work (Arzhel)
[x] Decide on a date Feb. 21st/22nd
[x] Verify router config is up to date with standards [Arzhel]
[x] Ship [[ https://netbox.wikimedia.org/dcim/devices/929/ | router ]] and associated [[ https://phabricator.wikimedia.org/T205487 | cables/optics ]] to arrive on Feb 20th latest
**Onsite**
[] Depool eqsin
[] Rack cr2-eqsin in U44
[] Connect mgmt/console/power
[] Verify working
[] Unplug Tata/NTT/PCCW from cr1-eqsin
[] Delete BGP config
[] Reconfigure ports:
cr1:xe-1/0/0 to cr2:???(already configured)
cr1:xe-2/0/0 to cr2:???(already configured)
```name=cr1-eqsin
delete interfaces xe-1/0/0
delete interfaces xe-2/0/0
delete interfaces xe-2/0/2
show interfaces interface-range external member xe-1/0/0
show interfaces interface-range external member xe-2/0/0
show interfaces interface-range external member xe-2/0/2
set interfaces interface-range disabled member xe-2/0/2
set interfaces interface-range disabled description DISABLED
set interfaces interface-range disabled disable
set interfaces xe-1/0/0 description "Core: cr2-eqsin:??? {#???} [10Gbps DF]"
set interfaces xe-1/0/0 gigether-options 802.3ad ae0
set interfaces xe-2/0/0 description "Core: cr2-eqsin:??? {#???} [10Gbps DF]"
set interfaces xe-2/0/0 gigether-options 802.3ad ae0
set interfaces ae0 description "Core: cr2-eqsin:ae0"
set interfaces ae0 mtu 9192
set interfaces ae0 aggregated-ether-options link-speed mixed
set interfaces ae0 aggregated-ether-options lacp active
set interfaces ae0 aggregated-ether-options lacp periodic fast
set interfaces ae0 unit 0 family inet address 103.102.166.140/31
set interfaces ae0 unit 0 family inet6 address 2001:df2:e500:fe05::1/64
set protocols ospf area 0.0.0.0 interface ae0.0 interface-type p2p
set protocols ospf3 area 0.0.0.0 interface ae0.0 interface-type p2p
set protocols pim interface ae0.0
set protocols bgp group Confed_eqsin type internal
set protocols bgp group Confed_eqsin local-address 103.102.166.129
set protocols bgp group Confed_eqsin family inet any
set protocols bgp group Confed_eqsin family inet6 any
set protocols bgp group Confed_eqsin peer-as 65005
set protocols bgp group Confed_eqsin local-as 65005
set protocols bgp group Confed_eqsin local-as no-prepend-global-as
set protocols bgp group Confed_eqsin neighbor 103.102.166.130
```
[] Connect cr1<-->cr2
[] Verify link/OSPF/BGP up
[] Connect cr2:??? (already configured)<-->asw:xe-0/0/20
[] Connect cr2:??? (already configured)<-->asw:xe-1/0/20
```name=cr1-eqsin
delete interfaces ae1 unit 510 family inet address 103.102.166.1/28
delete interfaces ae1 unit 510 family inet6 address 2001:df2:e500:1::1/64
set interfaces ae1 unit 510 family inet address 103.102.166.2/28 vrrp-group 1 virtual-address 103.102.166.1
set interfaces ae1 unit 510 family inet address 103.102.166.2/28 vrrp-group 1 accept-data
set interfaces ae1 unit 510 family inet address 103.102.166.2/28 vrrp-group 1 track interface ae1.510 priority-cost 50
set interfaces ae1 unit 510 family inet6 address 2001:df2:e500:1:fe00::1/64 vrrp-inet6-group 1 virtual-inet6-address 2001:df2:e500:1::1
set interfaces ae1 unit 510 family inet6 address 2001:df2:e500:1:fe00::1/64 vrrp-inet6-group 1 accept-data
set interfaces ae1 unit 510 family inet6 address 2001:df2:e500:1:fe00::1/64 vrrp-inet6-group 1 track interface ae1.510 priority-cost 50
set interfaces ae1 unit 510 family inet6 address fe80:0:0:0:fe00::1/64
delete interfaces ae1 unit 520 family inet address 10.132.0.1/24
delete interfaces ae1 unit 520 family inet6 address 2001:df2:e500:101::1/64
set interfaces ae1 unit 520 family inet address 10.132.0.2/24 vrrp-group 1 virtual-address 10.132.0.1
set interfaces ae1 unit 520 family inet address 10.132.0.2/24 vrrp-group 1 accept-data
set interfaces ae1 unit 520 family inet address 10.132.0.2/24 vrrp-group 1 track interface ae1.520 priority-cost 50
set interfaces ae1 unit 520 family inet6 address 2001:df2:e500:101:fe00::1/64 vrrp-inet6-group 1 virtual-inet6-address 2001:df2:e500:101::1
set interfaces ae1 unit 520 family inet6 address 2001:df2:e500:101:fe00::1/64 vrrp-inet6-group 1 accept-data
set interfaces ae1 unit 520 family inet6 address 2001:df2:e500:101:fe00::1/64 vrrp-inet6-group 1 track interface ae1.520 priority-cost 50
set interfaces ae1 unit 520 family inet6 address fe80:0:0:0:fe00::1/64
delete interfaces ae1 unit 530 family inet address 103.102.166.17/28
delete interfaces ae1 unit 530 family inet6 address 2001:df2:e500:201::1/64
set interfaces ae1 unit 530 family inet address 103.102.166.18/28 vrrp-group 1 virtual-address 103.102.166.17
set interfaces ae1 unit 530 family inet address 103.102.166.18/28 vrrp-group 1 track interface ae1.530 priority-cost 50
set interfaces ae1 unit 530 family inet6 address 2001:df2:e500:201:fe00::1/64 vrrp-inet6-group 1 virtual-inet6-address 2001:df2:e500:201::1
set interfaces ae1 unit 530 family inet6 address 2001:df2:e500:201:fe00::1/64 vrrp-inet6-group 1 track interface ae1.530 priority-cost 50
set interfaces ae1 unit 530 family inet6 address fe80:0:0:0:fe00::1/64
```
```name=asw1-eqsin
set vlans XLink2 description "cr2-eqsin <-> mr1-eqsin"
set vlans XLink2 vlan-id 402
set interfaces interface-range infrastructure member xe-0/0/20
set interfaces interface-range infrastructure member xe-1/0/20
set interfaces xe-0/0/20 description "Core: cr2-eqsin:??? {#???} [10Gbps DF]"
set interfaces xe-0/0/20 ether-options 802.3ad ae1
set interfaces xe-1/0/20 description "Core: cr2-eqsin:??? {#???} [10Gbps DF]"
set interfaces xe-1/0/20 ether-options 802.3ad ae1
set interfaces ae2 description "Core: cr2-eqsin:ae1"
set interfaces ae2 mtu 9192
set interfaces ae2 aggregated-ether-options lacp active
set interfaces ae2 aggregated-ether-options lacp periodic fast
set interfaces ae2 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae2 unit 0 family ethernet-switching vlan members XLink2
set interfaces ae2 unit 0 family ethernet-switching vlan members private1-eqsin
set interfaces ae2 unit 0 family ethernet-switching vlan members public1-eqsin
set interfaces ae2 unit 0 family ethernet-switching vlan members sandbox1-eqsin
```
[] Verify link up
[] Verify VRRP up with cr2 as master
[] Verify mr1<-->cr2 OPSF links
[] Connect Tata/NTT/PCCW to cr2-eqsin
[] Verify link/BGP/advertisements
[] Verify ulsfo tunnel
[] Merge monitoring Puppet CR - https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/490518
[] Add cr2 to LibreNMS - https://wikitech.wikimedia.org/wiki/LibreNMS#Add_a_device_to_LibreNMS
[] Add BGP sessions between cr2-eqsin and LVS
https://gerrit.wikimedia.org/r/c/operations/puppet/+/490525
```name=cr1-eqsin
delete protocols bgp group PyBal neighbor 10.132.0.13
delete routing-options static route 103.102.166.224/28 next-hop 10.132.0.11
delete routing-options static route 103.102.166.240/28 next-hop 10.132.0.12
set routing-options static route 103.102.166.224/28 next-hop 10.132.0.13
set routing-options static route 103.102.166.240/28 next-hop 10.132.0.13
```
```name=cr2-eqsin
set protocols bgp group PyBal neighbor 10.132.0.13
set routing-options static route 103.102.166.224/28 next-hop 10.132.0.11
set routing-options static route 103.102.166.240/28 next-hop 10.132.0.12
```
[] Verify working
[] Verify no diff in JNT
**Test redundancy**
[] For each LACP bundles, unplug 1 member and verify no impact
[] Power down cr1-eqsin
[] Measure failover time, ensure acceptable
[] Ensure alerting works
[] Power back up
[] Power down cr2-eqsin
[] Measure failover time, ensure acceptable
[] Ensure alerting works
[] Power back up
[] Verify both routers are back to normal
[] Repool eqsin
[] Update Netbox (vlan, links, device)
[] Update interfaces descriptions