Page MenuHomePhabricator

Low IPv6 bandwth from Free.fr (AS12322) > Zayo > eqiad
Closed, DeclinedPublic

Description

While oing apt-get requests to mirror.wikimedia.org / apt.wikimedia.org there is a notable speed difference between IPv4 and IPv6. My ISP is Proxad AS12322, routing over Zayo to reach eqiad. I guess there is less bandwith for IPv6 along the way or something throttle it -might be my ISP-.

Lame tests:

IPv4 fast
$ wget -4 https://apt.wikimedia.org/wikimedia/incoming/jenkins_1.625.2_all.deb
                                                          vvvvvvvv
jenkins_1.625.2_all 100%[=====================>]  59.63M  17.3MB/s   in 5.2s
                                                          ^^^^^^^^
IPv6 slow
$ wget -6 https://apt.wikimedia.org/wikimedia/incoming/jenkins_1.625.2_all.deb
                                                           vvvvvvv
jenkins_1.625.2_all 100%[=====================>]  59.63M   368KB/s   in 2m 58s 
                                                           ^^^^^^^

Trace:

$ traceroute -4 -q 1 -A apt.wikimedia.org
traceroute to apt.wikimedia.org (208.80.154.10), 30 hops max, 60 byte packets
 1  Freebox-Server.local (192.168.2.254) [*]  0.156 ms
 2  sch44-2-88-190-13-254.fbxo.proxad.net (88.190.13.254) [AS12322]  1.470 ms
 3  78.255.108.126 (78.255.108.126) [AS12322]  1.145 ms
 4  nantes-6k-1-v802.intf.nro.proxad.net (78.254.243.173) [AS12322]  1.418 ms
 5  nantes-crs8-2-be1003.intf.routers.proxad.net (194.149.161.177) [AS12322]  3.047 ms
 6  p11-crs16-1-be1110.intf.routers.proxad.net (194.149.162.109) [AS12322]  11.074 ms
 7  th2-9k-3-be1001.intf.routers.proxad.net (194.149.162.86) [AS12322]  7.880 ms
 8  ae2.mpr1.cdg11.fr.zip.zayo.com (64.125.14.37) [*]  7.598 ms
 9  ae27.cs1.cdg11.fr.eth.zayo.com (64.125.29.4) [*]  83.823 ms
10  *
11  ae5.cs2.lga5.us.eth.zayo.com (64.125.29.93) [*]  83.776 ms
12  ae0.cs1.lga5.us.eth.zayo.com (64.125.29.186) [*]  83.775 ms
13  ae4.cs1.dca2.us.eth.zayo.com (64.125.29.203) [*]  83.771 ms
14  ae27.cr1.dca2.us.zip.zayo.com (64.125.30.247) [*]  82.748 ms
15  *
16  64.125.192.142.IPYX-125449-001-ZYO.zip.zayo.com (64.125.192.142) [*]  103.321 ms
17  *
$ traceroute -6 -q 1 -A apt.wikimedia.org
traceroute to apt.wikimedia.org (2620:0:861:1:208:80:154:10), 30 hops max, 80 byte packets
 1  2a01:e35:8be0:d0d0::1 (2a01:e35:8be0:d0d0::1) [AS12322]  0.245 ms
 2  *
 3  2a01:e00:18::32 (2a01:e00:18::32) [AS12322]  8.135 ms
 4  2001:438:ffff::407d:e25 (2001:438:ffff::407d:e25) [*]  7.984 ms
 5  ae27.cs1.cdg11.fr.eth.zayo.com (2001:438:ffff::407d:1d04) [*]  84.060 ms
 6  *
 7  ae5.cs2.lga5.us.eth.zayo.com (2001:438:ffff::407d:1d5d) [*]  84.592 ms
 8  ae0.cs1.lga5.us.eth.zayo.com (2001:438:ffff::407d:1dba) [*]  85.295 ms
 9  ae4.cs1.dca2.us.eth.zayo.com (2001:438:ffff::407d:1dcb) [*]  83.829 ms
10  ae27.cr1.dca2.us.zip.zayo.com (2001:438:ffff::407d:1ef7) [*]  83.351 ms
11  ae6.er1.iad10.us.zip.zayo.com (2001:438:ffff::407d:1476) [*]  85.407 ms
12  2001:438:fffd:58::2 (2001:438:fffd:58::2) [*]  88.531 ms
13  *

I have the same behavior on either apt.wikimedia.org (carbon) or mirrors.wikimedia.org (sodium).

Event Timeline

hashar created this task.Nov 9 2016, 9:26 PM
Restricted Application added a project: Operations. · View Herald TranscriptNov 9 2016, 9:26 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
faidon closed this task as Declined.Nov 10 2016, 1:12 PM
faidon added a subscriber: faidon.

Since there is only one intermediate ASN between Proxad and us (Zayo) and the path within Zayo and within our network is basically exactly the same, I'd be inclined to say that this is an issue with Proxad and one that we can't do much about.

If I had to guess, I'd blame some tunneling on your ISP's side — Free.fr was involved in the creation and early adoption of 6rd after all, which employs gateways to pass the traffic. They may have rolled out native IPv6 by now, though, so it may not be a factor anymore.

As next steps, I'd suggest contacting your ISP to report this issue. In the meantime, what I will do is ask AS12322 to peer with us in the US as well, since they have a presence there. This would take Zayo out of the loop entirely and would help prove that this is indeed a Proxad issue.