Page MenuHomePhabricator
Create Task
Maniphest T76390

After switch to local ssl terminators, pagecounts-raw (C implementation of webstatscollector) overcounts HTTPS from some data-centers.
Closed, ResolvedPublic
Actions

Description

The merging of https://gerrit.wikimedia.org/r/#/c/175465/ changed the SSL setup of the caches, and makes
webstatscollector's C implementation count SSL requests twice.

Details

SubjectRepoBranchLines +/-
Ignore traffic from cache-local SSL terminatorsanalytics/refinerymaster+7 -2
Ignore traffic from cache-local SSL terminatorsanalytics/webstatscollectormaster+6 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

QChris created this task.Dec 1 2014, 9:36 PM
QChris raised the priority of this task from to Needs Triage.
QChris updated the task description. (Show Details)
QChris added a project: Analytics.
QChris changed Security from none to None.
QChris subscribed.
QChris claimed this task.Dec 1 2014, 9:39 PM
QChris mentioned this in T76334: Network outage on 2014-11-30 affecting analytics infrastructure.
gerritbot added a project: Patch-For-Review.Dec 2 2014, 11:02 PM

Change 177101 had a related patch set uploaded (by QChris):
Ignore traffic from cache-local SSL terminators

https://gerrit.wikimedia.org/r/177101

Patch-For-Review

gerritbot added a comment.Dec 3 2014, 2:52 PM

Change 177224 had a related patch set uploaded (by QChris):
Ignore traffic from cache-local SSL terminators

https://gerrit.wikimedia.org/r/177224

Patch-For-Review

gerritbot added a comment.Dec 3 2014, 9:14 PM

Change 177101 merged by Ottomata:
Ignore traffic from cache-local SSL terminators

https://gerrit.wikimedia.org/r/177101

gerritbot added a comment.Dec 4 2014, 1:36 PM

Change 177224 merged by Ottomata:
Ignore traffic from cache-local SSL terminators

https://gerrit.wikimedia.org/r/177224

QChris added a comment.Dec 4 2014, 11:24 PM

ottomata deployed the fixed webstatscollector between 2014-12-04T14:00:00 and 2014-12-04T14:03:00.
The corresponding refinery change to make implementations match again (although refinery is not affected by the overcounting) got deployed 2014-12-04T21:51.
Oozie will rerun pagecounts-all-sites from 2014-11-25T00 on. Those files will get filtered to backfill pagecount-raw.

QChris closed this task as Resolved.Dec 8 2014, 10:50 PM

Backfilling is now complete.

QChris mentioned this in rANRE37bb32af8242: Ignore traffic from cache-local SSL terminators.Dec 31 2014, 6:11 PM
QChris mentioned this in rANWC0c51f8d3ed13: Ignore traffic from cache-local SSL terminators.Dec 31 2014, 6:14 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits