Network outage on 2014-11-30 affecting analytics infrastructure
Closed, ResolvedPublic
Actions

Description

On 2014-11-30, a network outage affected analytics machines and thereby datesets.
We collect the effects and status of backfilling in this bug.

Dataset	Affected?	Will be backfilled?
Analytics slave databases	no	---
Analytics cluster	no	---
Pagecounts-all-sites	no	---
Pagecounts-raw	yes	yes, not completed yet
TSVs	yes	no
EventLogging database	yes	yes, done
EventLogging graphite graphs	yes	no
geowiki	yes	yes, done
Wikipedia Zero graphs	yes	Excluded 2014-11-30 from plots

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		QChris	T76334 Network outage on 2014-11-30 affecting analytics infrastructure
		Resolved		QChris	T76390 After switch to local ssl terminators, pagecounts-raw (C implementation of webstatscollector) overcounts HTTPS from some data-centers.

Event Timeline

QChris created this task.Dec 1 2014, 11:50 AM

QChris claimed this task.

QChris raised the priority of this task from to Needs Triage.

QChris updated the task description. (Show Details)

QChris added a project: Analytics.

QChris changed Security from none to None.

QChris added a subscriber: QChris.

It seems a recent change of the HTTPS setup makes pagecounts-raw overcount (T76390). Hence, we
first put pagecount-raw on a sane footing again and then backfill for 2014-11-30 in a consistent way.

QChris added a subtask: T76390: After switch to local ssl terminators, pagecounts-raw (C implementation of webstatscollector) overcounts HTTPS from some data-centers..Dec 1 2014, 9:40 PM

QChris added a project: Incident-20141130-eqiad-C4.Dec 2 2014, 2:34 PM

Backfilling pagecounts-raw has been completed

Network outage on 2014-11-30 affecting analytics infrastructureClosed, ResolvedPublicActions

Description

Related ObjectsSearch...

Event Timeline

Network outage on 2014-11-30 affecting analytics infrastructure
Closed, ResolvedPublic
Actions

Related Objects
Search...