Large numbers of pageviews not being reported in statistics


It was recently observed ( ) that total pageviews for some large projects on enwiki have been dropping for several months.

The table on shows that even though the number of articles in the project has increased, the number of pageviews dropped from 231M in October 2012 to 171M in October 2013.

To test this, I wrote a script that loaded a non-existent page (so that there would be no other hits to that page) every 10 seconds, reporting the number of hits every hour. Then I compared that to the number in the raw pagecounts files.

The full details are at

Long story short, the problem seems to track the overall load on the site, with busy hours losing 20-30% and quiet hours 5-10%, around 15% on average. This suggests that the logging program is not adequately handling the load.

This may be the same problem as bug 49266

Version: unspecified
Severity: major

bzimport added a subscriber: Unknown Object (MLST).
bzimport set Reference to bz58036.
Mr.Z-man created this task.Via LegacyDec 5 2013, 3:28 PM

Add Comment