Page MenuHomePhabricator

Some raw webrequest partitions for 2014-12-11T14/1H not marked successful
Closed, ResolvedPublic

Description

3 of the webrequest partitions *) for 2014-12-11T14/1H have not been
marked successful.

What happened?

*)

_________________________________________________________________
qchris@stat1002 // jobs: 0 // time: 15:23:10 // exit code: 0
cwd: ~
~/cluster-scripts/dump_webrequest_status.sh 600
  +------------------+--------+--------+--------+--------+
  | Date             |  bits  | mobile |  text  | upload |
  +------------------+--------+--------+--------+--------+
[...]
  | 2014-12-11T13/1H |    .   |    .   |    .   |    .   |
  | 2014-12-11T14/1H |    X   |    .   |    X   |    X   |
  | 2014-12-11T15/1H |    .   |    .   |    .   |    .   |
[...]
  +------------------+--------+--------+--------+--------+


Statuses:

  . --> Partition is ok
  M --> Partition manually marked ok
  X --> Partition is not ok (duplicates, missing, or nulls)

Event Timeline

QChris closed this task as Resolved.
QChris claimed this task.
QChris raised the priority of this task from to Needs Triage.
QChris updated the task description. (Show Details)
QChris added subscribers: Unknown Object (MLST), kevinator, QChris and 3 others.

Analytics1021 dropped out it's partition leader role around 2014-12-11T14:54 (which caused loss ~1 seconds worth of traffic).


  • bits

Affected period: 2014-12-11T14:54:31 -- 2014-12-11T14:54:36

Duplicates: 0
Missing: 1859

HostStart of issueEnd of issue
cp1056.eqiad.wmnet2014-12-11T14:54:322014-12-11T14:54:33
cp1057.eqiad.wmnet2014-12-11T14:54:332014-12-11T14:54:33
cp1070.eqiad.wmnet2014-12-11T14:54:322014-12-11T14:54:33
cp3020.esams.wikimedia.org2014-12-11T14:54:322014-12-11T14:54:32
cp3021.esams.wikimedia.org2014-12-11T14:54:312014-12-11T14:54:33
cp4001.ulsfo.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp4002.ulsfo.wmnet2014-12-11T14:54:352014-12-11T14:54:36
cp4003.ulsfo.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp4004.ulsfo.wmnet2014-12-11T14:54:342014-12-11T14:54:35

(cp3022.esams.wikimedia.org had 252 duplicates which got
deduplicated.)


  • text

Affected period: 2014-12-11T14:54:33 -- 2014-12-11T14:54:35
Duplicates: 0
Missing: 4287

HostStart of issueEnd of issue
amssq31.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq32.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq34.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq35.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq36.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq37.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq38.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq39.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq40.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq41.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq42.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq43.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq44.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq45.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq46.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq47.esams.wmnet2014-12-11T14:54:332014-12-11T14:54:34
amssq48.esams.wikimedia.org2014-12-11T14:54:332014-12-11T14:54:34
amssq49.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:35
amssq50.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:35
amssq51.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:34
amssq52.esams.wikimedia.org2014-12-11T14:54:332014-12-11T14:54:34
amssq53.esams.wikimedia.org2014-12-11T14:54:332014-12-11T14:54:34
amssq54.esams.wikimedia.org2014-12-11T14:54:332014-12-11T14:54:34
amssq55.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:35
amssq56.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:35
amssq57.esams.wikimedia.org2014-12-11T14:54:332014-12-11T14:54:34
amssq58.esams.wikimedia.org2014-12-11T14:54:332014-12-11T14:54:34
amssq59.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:35
amssq60.esams.wikimedia.org2014-12-11T14:54:332014-12-11T14:54:34
amssq61.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:35
amssq62.esams.wikimedia.org2014-12-11T14:54:342014-12-11T14:54:35
cp1052.eqiad.wmnet2014-12-11T14:54:332014-12-11T14:54:34
cp1053.eqiad.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp1054.eqiad.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp1055.eqiad.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp1065.eqiad.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp1066.eqiad.wmnet2014-12-11T14:54:332014-12-11T14:54:34
cp1067.eqiad.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp1068.eqiad.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp4008.ulsfo.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp4009.ulsfo.wmnet2014-12-11T14:54:332014-12-11T14:54:34
cp4010.ulsfo.wmnet2014-12-11T14:54:332014-12-11T14:54:34
cp4016.ulsfo.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp4017.ulsfo.wmnet2014-12-11T14:54:342014-12-11T14:54:35
cp4018.ulsfo.wmnet2014-12-11T14:54:342014-12-11T14:54:35

  • upload

Affected period: 2014-12-11T14:54:32 -- 2014-12-11T14:54:34
Duplicates: 0
Missing: 987

HostStart of issueEnd of issue
cp1049.eqiad.wmnet2014-12-11T14:54:322014-12-11T14:54:33
cp4005.ulsfo.wmnet2014-12-11T14:54:322014-12-11T14:54:33
cp4006.ulsfo.wmnet2014-12-11T14:54:322014-12-11T14:54:33
cp4007.ulsfo.wmnet2014-12-11T14:54:322014-12-11T14:54:33
cp4013.ulsfo.wmnet2014-12-11T14:54:332014-12-11T14:54:34
cp4015.ulsfo.wmnet2014-12-11T14:54:322014-12-11T14:54:33