Raw webrequest partitions for 2014-12-07T18/1H not marked successful
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	QChris
	Dec 8 2014, 2:47 PM

Description

The raw bits webrequest partition *) for 2014-12-07T18/1H has been
been marked successful.

What happened?

_________________________________________________________________
qchris@stat1002 // jobs: 0 // time: 14:34:32 // exit code: 0
cwd: ~/cluster-scripts
~/cluster-scripts/dump_webrequest_status.sh

  +------------------+--------+--------+--------+--------+
  | Date             |  bits  | mobile |  text  | upload |
  +------------------+--------+--------+--------+--------+
[...]
  | 2014-12-07T16/1H |    M   |    .   |    .   |    .   |
  | 2014-12-07T17/1H |    .   |    .   |    .   |    .   |
  | 2014-12-07T18/1H |    X   |    .   |    .   |    .   |
  | 2014-12-07T19/1H |    X   |    .   |    .   |    .   |
  | 2014-12-07T20/1H |    X   |    .   |    .   |    .   |
[...]
  +------------------+--------+--------+--------+--------+


Statuses:

  . --> Partition is ok
  M --> Partition manually marked ok
  X --> Partition is not ok (duplicates, missing, or nulls)

Related Objects
Search...

Status	Assigned	Task
Resolved	Ottomata	T72085 Raw webrequest partitions that were not marked successful
Resolved	Ottomata	T74809 Raw webrequest partitions that were not marked successful due to only esams caches causing unknown problems
Declined	None	T77022 Raw webrequest partitions for 2014-12-07T18/1H not marked successful

Event Timeline

QChris created this task.Dec 8 2014, 2:47 PM

QChris raised the priority of this task from to Medium.

QChris updated the task description. (Show Details)

QChris added a project: Analytics-Clusters.

QChris changed Security from none to None.

QChris added subscribers: Unknown Object (MLST), • kevinator, QChris and 2 others.

2014-12-07T16/1H is handled in T71615#823935
2014-12-07T19/1H is handled in T77023.
2014-12-07T20/2H is handled in T77024.

It affects only esams bits caches, but all of them.

Host	Start of issue	End of issue
cp3019.esams.wikimedia.org	2014-12-07T18:07:04	2014-12-07T18:26:58
cp3020.esams.wikimedia.org	2014-12-07T18:09:36	2014-12-07T18:28:01
cp3021.esams.wikimedia.org	2014-12-07T18:05:30	2014-12-07T18:24:23
cp3022.esams.wikimedia.org	2014-12-07T18:08:33	2014-12-07T18:22:46

Between, 2014-12-07T18:05:30 and 2014-12-07T18:28:01, the esams bits have:

~3M duplicates (worth ~2 minutes of overall bits traffic), and
~10M missing lines (worth ~6 minutes of overall bits traffic).

Ottomata closed this task as Declined.Mar 31 2015, 2:10 PM

Raw webrequest partitions for 2014-12-07T18/1H not marked successfulClosed, DeclinedPublicActions

Description

Related ObjectsSearch...

Event Timeline

Raw webrequest partitions for 2014-12-07T18/1H not marked successful
Closed, DeclinedPublic
Actions

Related Objects
Search...