Sites are unreachable from Fastweb users in Italy and probably some millions other Init7 users
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Nemo_bis
	Nov 25 2014, 9:10 PM

Description

Already logged in SAL, reported to ops@ and #wikimedia-tech including RelEng and socialmedia, tweeted as @WikimediaItalia (I'm not sure it's a good idea to suggest editing host file).

$ mtr -w -c 100 bits.wikimedia.org
Start: Tue Nov 25 21:52:06 2014
HOST: e350                             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 192.168.1.254                     0.0%   100    1.4   2.0   1.2   7.7   1.2
  2.|-- 10.57.94.195                      2.0%   100   41.3  68.8   8.2 100.3  15.3
  3.|-- 10.251.136.89                    70.0%   100   71.8  68.5  24.9  99.4  14.6
  4.|-- 10.251.132.44                     2.0%   100   57.9  68.7  39.8  98.4  12.8
  5.|-- 10.251.133.1                     62.0%   100   42.0  63.4  27.3  87.6  14.4
  6.|-- 10.251.137.186                    2.0%   100   55.5  65.9  37.1  93.3  13.4
  7.|-- 10.0.56.9                         2.0%   100   61.0  65.7  31.5  99.6  13.7
  8.|-- 10.0.1.106                        1.0%   100   57.0  64.6  31.7 116.1  16.1
  9.|-- 10.254.11.21                      2.0%   100   54.6  63.3  34.8  99.5  14.7
 10.|-- 10.254.9.145                      0.0%   100   66.8  70.2  25.8 238.5  27.6
 11.|-- 93-63-100-113.ip27.fastwebnet.it  3.0%   100   79.1  62.9  32.0 104.9  17.6
 12.|-- 62-101-124-74.fastres.net         1.0%   100  171.3 164.0  20.4 208.9  26.6
 13.|-- 89.96.200.18                      2.0%   100  173.4 163.8 124.9 228.5  17.1
 14.|-- r1fra1.core.init7.net             1.0%   100  224.6 202.2 148.7 267.4  17.7
 15.|-- ???                              100.0   100    0.0   0.0   0.0   0.0   0.0

Event Timeline

Nemo_bis created this task.Nov 25 2014, 9:10 PM

Nemo_bis raised the priority of this task from to Unbreak Now!.

Nemo_bis updated the task description. (Show Details)

Nemo_bis added projects: acl*sre-team, WMF-General-or-Unknown, Upstream.

Nemo_bis changed Security from none to None.

Nemo_bis added subscribers: Nemo_bis, acl*sre-team.

Reedy updated the task description. (Show Details)Nov 25 2014, 9:29 PM

Reedy subscribed.

Reedy unsubscribed.

Nemo_bis updated the task description. (Show Details)Nov 25 2014, 9:36 PM

Better now.

$ mtr -w -c 10 it.wikipedia.org
Start: Tue Nov 25 22:48:19 2014
HOST: e350                             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 192.168.1.254                     0.0%    10    2.2   1.6   1.3   2.2   0.0
  2.|-- 10.57.94.195                      0.0%    10   40.1  28.8  13.4  64.1  14.9
  3.|-- 10.251.136.89                    50.0%    10   30.7  49.4  19.5  72.0  23.8
  4.|-- 10.251.132.44                     0.0%    10   34.0  46.2   4.3  80.5  26.6
  5.|-- 10.251.133.1                     60.0%    10   33.6  46.3   8.9  89.3  34.0
  6.|-- 10.251.137.186                    0.0%    10   50.3  39.2   4.9  75.0  22.9
  7.|-- 10.0.56.41                        0.0%    10   66.9  40.5   3.4  71.2  23.2
  8.|-- 10.0.1.106                        0.0%    10   48.2  34.0   4.1  83.6  26.7
  9.|-- 10.254.0.89                       0.0%    10   23.5  24.0   4.2  53.6  19.1
 10.|-- 10.254.12.189                     0.0%    10   19.8  29.1   3.3  66.5  19.3
 11.|-- 93-63-100-117.ip27.fastwebnet.it  0.0%    10   31.2  34.0   4.0  77.3  24.0
 12.|-- 89.96.200.109                     0.0%    10   59.2  41.9   5.4  73.9  22.1
 13.|-- 89.96.200.190                     0.0%    10   46.0  35.3   8.2  50.7  14.1
 14.|-- r1fra1.core.init7.net             0.0%    10   92.6 111.3  92.6 142.3  17.1
 15.|-- r1ams1.core.init7.net            40.0%    10   30.4  59.3  30.4 100.2  27.7
 16.|-- r1ams2.core.init7.net             0.0%    10   52.3  68.8  44.6 104.6  20.8
 17.|-- gw-wikimedia.init7.net           10.0%    10   62.3  52.3  28.3  99.1  21.7
 18.|-- text-lb.esams.wikimedia.org       0.0%    10   43.7  58.1  34.8 138.0  30.2

14.|-- r1fra1.core.init7.net             0.0%   100   30.9  27.9  18.8 136.7  14.2
15.|-- r1fra5.core.init7.net             1.0%   100   20.0  22.2  18.4  69.1   7.9
16.|-- r1dus1.core.init7.net             0.0%   100   19.5  22.7  18.7  64.9   7.6
17.|-- r1ams1.core.init7.net             0.0%   100   25.4  23.9  19.0  63.0   8.6
18.|-- r1ams2.core.init7.net             0.0%   100   34.1  27.4  19.1  74.2  11.2
19.|-- gw-wikimedia.init7.net            0.0%   100   75.9  27.1  19.8  86.6  13.0
20.|-- text-lb.esams.wikimedia.org       0.0%   100   25.2  23.2  19.6  55.8   6.9

@Krinkle found http://www.init7.net/de/status/?ticket=8091 which seems related.

Sites are unreachable from Fastweb users in Italy and probably some millions other Init7 usersClosed, ResolvedPublicActions

Description

Event Timeline

Sites are unreachable from Fastweb users in Italy and probably some millions other Init7 users
Closed, ResolvedPublic
Actions