" in URL in zero logs
Closed, ResolvedPublic
Actions

Assigned To

None

Authored By

	QChris
	Aug 4 2014, 5:38 PM

Description

/wiki/ and ZeroRatedMobileAccess requests per hour for 250-99

Since 2014-07-29 ~23:00, zero tags for 250-99 look wrong:

The zero=250-99 tagged log lines declined a bit in total numbers.
The zero=250-99 tagged log lines with "/wiki/" in URL dropped by ~80%.
The zero=250-99 tagged log lines with "ZeroRatedMobileAccess" in URL increased drastically.

The time of the change roughly matches

I3ce7975705bd704f140a397f2233928a21ab39bd

which looks relevant.

Due to the "/wiki/" hits going down, the page views reported on the
dashboard are jumping down too.

See the attached plot of number of zero=250-99 tagged log lines per
hour with "/wiki/" in URL, and with ZeroRatedMobileAccess in URL.

(The short change on 2014-07-25 seems to match

Ieeb940b27d75e73ce54ad0ab74ac9b72cdfbb881

and it's subsequent revert

Ica00438edadc8cd06bc646ac1552c477e12dd0fa

)

Version: unspecified
Severity: normal
Whiteboard: u=WikipediaZero c=General/Unknown p=0 s=2014-07-24

Attached:

Details

Reference: bz69112

Event Timeline

• bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:35 AM

• bzimport added a project: Analytics-General-or-Unknown.

• bzimport set Reference to bz69112.

• bzimport added a subscriber: Unknown Object (MLST).

QChris created this task.Aug 4 2014, 5:38 PM

The graph and above numbers were computed by the

/a/squid/archive/zero/zero.tsv.log-*

files on stat1002.

This is per https://www.mediawiki.org/wiki/Requests_for_comment/Unified_ZERO_design#Analytics

The new requests should still have X-Analytics=X-CS=250-99, even though the X-CS header will be set to "ON". If it doesn't, its a bug.

Requests for ZeroRatedMobileAccess?zcmd=... should not be counted - they are resource requests to get the banner.

The change I3ce7975705bd704f140a397f2233928a21ab39bd is what switched zero to the new unified model. We plan to switch the rest of zero partners to the same model.

Hi Yuri -- how was this change communicated? It seems like we were taken by surprise.

thanks,

-Toby

Change 151693 had a related patch set uploaded by QChris:
Remove X-CS pre-deliver filtering

https://gerrit.wikimedia.org/r/151693

Change 151693 merged by BBlack:
Remove X-CS pre-deliver filtering

https://gerrit.wikimedia.org/r/151693

(In reply to Yuri Astrakhan from comment #2)

The new requests should still have X-Analytics=X-CS=250-99, even though the
X-CS header will be set to "ON". If it doesn't, its a bug.

(I guess by 'X-CS' you're refering to 'zero' tags in the final X-Analytics
header.)

It was a vcl bug.
Preliminary checks show that Yuri's above patch (comment 4, and
comment 5) fixes it.

I'll do more checking, when more data has been fed into the pipeline.

Requests for ZeroRatedMobileAccess?zcmd=... should not be counted - they are
resource requests to get the banner.

No worries, they are not counted.

(In reply to christian from comment #6)

I'll do more checking, when more data has been fed into the pipeline.

Things are back to normal.
Thanks for prompt fix Yuri!

Drop by ~80% in zero=250-99 tagged lines with "/wiki/" in URL in zero logsClosed, ResolvedPublicActions

Description

Details

Event Timeline

Drop by ~80% in zero=250-99 tagged lines with "/wiki/" in URL in zero logs
Closed, ResolvedPublic
Actions