Page MenuHomePhabricator
Paste P18080

Adjust export policy applied on eqiad CRs for local confed to not rewrite next-hop for routes learnt from other WMF POPs
ActivePublic
Actions

Authored by cmooney on Dec 9 2021, 12:10 PM.
**** ADJUST iBGP EXPORT POLICY ON cr1-eqiad AND cr2-eqiad ***
#### BEFORE
cmooney@re0.cr2-eqiad> show route table inet.0 receive-protocol bgp 208.80.154.196 aspath-regex "^65004 .*"
inet.0: 864589 destinations, 2761473 routes (862538 active, 4 holddown, 3381 hidden)
Restart Complete
Prefix Nexthop MED Lclpref AS path
103.102.166.224/32 208.80.154.196 2342 100 (65004 65005) 64600 I
103.102.166.225/32 208.80.154.196 2342 100 (65004 65005) 64600 I
103.102.166.226/32 208.80.154.196 2342 100 (65004 65005) 64600 I
103.102.166.240/32 208.80.154.196 2342 100 (65004 65005) 64600 I
198.35.26.96/32 208.80.154.196 732 100 (65004) 64600 I
198.35.26.97/32 208.80.154.196 732 100 (65004) 64600 I
198.35.26.98/32 208.80.154.196 732 100 (65004) 64600 I
198.35.26.112/32 208.80.154.196 732 100 (65004) 64600 I
198.73.209.0/24 208.80.154.196 730 250 (65004) 11820 ?
{master}
cmooney@re0.cr2-eqiad> show route table inet.0 receive-protocol bgp 208.80.154.196 aspath-regex "^64600 .*" | last 5
208.80.154.241/32 208.80.154.196 0 100 64600 I
208.80.154.242/32 208.80.154.196 0 100 64600 I
208.80.154.243/32 208.80.154.196 0 100 64600 I
208.80.154.250/32 208.80.154.196 0 100 64600 I
208.80.154.252/32 208.80.154.196 0 100 64600 I
cmooney@bast1003:~$ sudo mtr -z -b -w -c 5 103.102.166.224
Start: 2021-12-09T10:40:13+0000
HOST: bast1003 Loss% Snt Last Avg Best Wrst StDev
1. AS14907 ae4-1004.cr2-eqiad.wikimedia.org (208.80.155.99) 0.0% 5 0.3 0.3 0.2 0.6 0.1
2. AS14907 ae0.cr1-eqiad.wikimedia.org (208.80.154.193) 0.0% 5 1.5 0.6 0.3 1.5 0.5
3. AS14907 xe-5-2-1.cr1-codfw.wikimedia.org (208.80.153.221) 0.0% 5 30.4 30.3 30.3 30.5 0.1
4. AS14907 xe-0-1-0.cr3-eqsin.wikimedia.org (103.102.166.138) 0.0% 5 247.0 256.5 247.0 294.0 21.0
5. AS14907 text-lb.eqsin.wikimedia.org (103.102.166.224) 0.0% 5 247.0 247.0 247.0 247.1 0.0
cmooney@bast1003:~$ sudo mtr -z -b -w -c 5 91.198.174.192
Start: 2021-12-09T10:40:50+0000
HOST: bast1003 Loss% Snt Last Avg Best Wrst StDev
1. AS14907 ae4-1004.cr2-eqiad.wikimedia.org (208.80.155.99) 0.0% 5 0.3 0.3 0.3 0.3 0.0
2. AS14907 xe-0-1-3.cr2-esams.wikimedia.org (91.198.174.249) 0.0% 5 81.2 81.2 81.2 81.4 0.1
3. AS14907 text-lb.esams.wikimedia.org (91.198.174.192) 0.0% 5 81.1 81.1 81.1 81.4 0.1
cmooney@bast1003:~$ sudo mtr -z -b -w -c 5 10.2.1.1
Start: 2021-12-09T10:44:46+0000
HOST: bast1003 Loss% Snt Last Avg Best Wrst StDev
1. AS14907 ae4-1004.cr2-eqiad.wikimedia.org (208.80.155.99) 0.0% 5 0.4 0.5 0.3 1.0 0.3
2. AS14907 xe-5-0-2.cr2-codfw.wikimedia.org (208.80.154.215) 0.0% 5 33.3 33.2 33.2 33.3 0.0
3. AS??? appservers.svc.codfw.wmnet (10.2.1.1) 0.0% 5 33.2 33.2 33.2 33.2 0.0
sukhe: I love the HAL9000 motd on the doh machines :)
###### AFTER
cmooney@re0.cr2-eqiad> show route table inet.0 receive-protocol bgp 208.80.154.196 aspath-regex "^65004 .*"
inet.0: 864795 destinations, 2700685 routes (862748 active, 0 holddown, 3665 hidden)
Restart Complete
Prefix Nexthop MED Lclpref AS path
103.102.166.224/32 10.132.0.11 2342 100 (65004 65005) 64600 I
103.102.166.225/32 10.132.0.11 2342 100 (65004 65005) 64600 I
103.102.166.226/32 10.132.0.11 2342 100 (65004 65005) 64600 I
103.102.166.240/32 10.132.0.12 2342 100 (65004 65005) 64600 I
198.35.26.96/32 10.128.0.15 732 100 (65004) 64600 I
198.35.26.97/32 10.128.0.15 732 100 (65004) 64600 I
198.35.26.98/32 10.128.0.15 732 100 (65004) 64600 I
198.35.26.112/32 10.128.0.16 732 100 (65004) 64600 I
198.73.209.0/24 198.35.26.228 730 250 (65004) 11820 ?
# commit confirmed will be rolled back in 8 minutes
{master}
cmooney@re0.cr2-eqiad> show route table inet.0 receive-protocol bgp 208.80.154.196 aspath-regex "^64600 .*" | last 5
208.80.154.241/32 208.80.154.196 0 100 64600 I
208.80.154.242/32 208.80.154.196 0 100 64600 I
208.80.154.243/32 208.80.154.196 0 100 64600 I
208.80.154.250/32 208.80.154.196 0 100 64600 I
208.80.154.252/32 208.80.154.196 0 100 64600 I
cmooney@bast1003:~$ sudo mtr -z -b -w -c 5 103.102.166.224
Start: 2021-12-09T11:31:44+0000
HOST: bast1003 Loss% Snt Last Avg Best Wrst StDev
1. AS14907 ae4-1004.cr2-eqiad.wikimedia.org (208.80.155.99) 0.0% 5 3.7 2.8 0.2 5.0 2.3
2. AS14907 ae0.cr1-eqiad.wikimedia.org (208.80.154.193) 0.0% 5 0.3 0.8 0.3 1.4 0.6
3. AS14907 xe-5-2-1.cr1-codfw.wikimedia.org (208.80.153.221) 0.0% 5 31.1 30.5 30.3 31.1 0.4
4. AS14907 xe-0-1-0.cr3-eqsin.wikimedia.org (103.102.166.138) 0.0% 5 247.3 247.3 247.1 247.8 0.3
5. AS14907 text-lb.eqsin.wikimedia.org (103.102.166.224) 0.0% 5 247.0 247.1 247.0 247.3 0.1
cmooney@bast1003:~$ sudo mtr -z -b -w -c 5 91.198.174.192
Start: 2021-12-09T11:32:13+0000
HOST: bast1003 Loss% Snt Last Avg Best Wrst StDev
1. AS14907 ae4-1004.cr2-eqiad.wikimedia.org (208.80.155.99) 0.0% 5 0.4 0.5 0.3 0.9 0.2
2. AS14907 xe-0-1-3.cr2-esams.wikimedia.org (91.198.174.249) 0.0% 5 81.2 81.2 81.2 81.2 0.0
3. AS14907 text-lb.esams.wikimedia.org (91.198.174.192) 0.0% 5 81.1 81.1 81.1 81.1 0.0
cmooney@bast1003:~$ sudo mtr -z -b -w -c 5 10.2.1.1
Start: 2021-12-09T11:32:34+0000
HOST: bast1003 Loss% Snt Last Avg Best Wrst StDev
1. AS14907 ae4-1004.cr2-eqiad.wikimedia.org (208.80.155.99) 0.0% 5 0.4 0.5 0.3 1.0 0.3
2. AS14907 xe-5-0-2.cr2-codfw.wikimedia.org (208.80.154.215) 0.0% 5 33.1 33.4 33.1 34.1 0.4
3. AS??? appservers.svc.codfw.wmnet (10.2.1.1) 0.0% 5 33.2 33.2 33.2 33.2 0.0
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL