Page MenuHomePhabricator

Verify X-Analytics: preview=1 in stable
Closed, ResolvedPublic0 Estimated Story Points

Description

As a data analyst, I want to ensure that the X-Analytics: preview=1 header when sent from the web client is observed in Hive for the stable cluster.

Sign off

  • Verify in Hive that well formed URLs contain the expected X-Analytics value

Event Timeline

Update on this task. This may need to go back for re-work / result in a new task that changes the key-value for the header enrichment, per discussion with @BBlack, @Nuria, @mobrovac et al.

This is what I mentioned yesterday in face-to-face meetings and in a forwarded message.

@dr0ptp4kt it is unlikely that apps need to change.

@Nuria, awesome - it sounds like you'll have VCL that will classify preview=1 when client-initiated inside of X-Analytics. Do I understand correctly that would apply equally to the use case embodied by this task, which is where the browser does the header enrichment?

Do I understand correctly that would apply equally to the use case embodied by this task, which is where the browser does the header enrichment?

Correct

Looks to be working based on data from the hour 2016051801 on English Wikipedia. Closing this task.

select x_analytics_map['preview'], access_method,
agent_type, count(1)
from webrequest
where year = 2016 and month = 5 and day = 18 and hour = 1
and normalized_host.project = 'en' and normalized_host.project_class = 'wikipedia' group by x_analytics_map['preview'], access_method, agent_type;

_c0	access_method	agent_type	_c3
1	desktop	user	4391
NULL	mobile web	spider	587058
NULL	desktop	spider	12247717
NULL	mobile app	user	1293878
1	mobile app	user	33843
NULL	mobile web	user	20582344
NULL	desktop	user	33998978