Page MenuHomePhabricator
Create Task
Maniphest T90235

Substantial amount of ip addresses in 1:1000 sampled squid logs does not resolve into geo data, from Nov 2013 onwards
Closed, DeclinedPublic
Actions

Description

There is a large percentage 'country Unknown' in squid log reports like
http://stats.wikimedia.org/wikimedia/squids/SquidReportPageViewsPerCountryOverview2014Q4.htm.

which made me halt publication of N/S view/edit ratios for Q4, so upgrade yet for
http://stats.wikimedia.org/wikimedia/squids/PercentagesEditsViewsSouth_2014_Q3.png

Any fix can only be applied to data for last 3 months, so we need to push this forward.

I seems that only certain ip ranges do not resolve.
I will pursue this further.

Event Timeline

• ezachte created this task.Feb 20 2015, 5:30 PM
• ezachte claimed this task.
• ezachte raised the priority of this task from to High.
• ezachte updated the task description. (Show Details)
• ezachte subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 20 2015, 5:30 PM
Krenair added a project: Analytics.Feb 20 2015, 6:36 PM
Krenair subscribed.

Sounds Analytics-y to me.

Milimetric subscribed.Dec 9 2015, 5:46 PM

Do the new UDF functions for handling X-Forwarded-For take care of this problem, Erik?

Milimetric set Security to None.Dec 9 2015, 5:46 PM
Milimetric moved this task from Incoming to Event Platform on the Analytics board.
• Nuria subscribed.Aug 15 2016, 3:53 PM

We are about to remove sample logs in favor of new pageview definition pageview counts.

This report has the newest data: https://stats.wikimedia.org/wikimedia/squids/SquidReportPageViewsPerCountryBreakdown.htm

• Nuria closed this task as Declined.Aug 15 2016, 3:53 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits