Page MenuHomePhabricator

PM sees reports on browsers (Weekly or Daily) {lama} [8 pts]
Closed, ResolvedPublic

Description

Browser report for mobile folks.

Mobile team needs a browser report from which they can infer browser usage. The very first stage of this report can include browser info but I do not think is necessary to include device info. A weekly recurrence (or even monthly) should likely be sufficient. Please get input from mobile team.

Example of how things could look like:
Android 3.2, Chrome 23%
iOS 8.0, Chrome 14%
iOS 7.0, Safari, 12%
Opera mini 2%

To make this more efficient: we can go against the wmf.pageview_hourly table

Link to the data:
https://hue.wikimedia.org/filebrowser/#/wmf/data/archive/browser/general

Event Timeline

Nuria raised the priority of this task from to Needs Triage.
Nuria updated the task description. (Show Details)
Nuria added a project: Analytics-Engineering.
Nuria added subscribers: Nuria, Tfinc, Jdlrobson.
kevinator renamed this task from Browser report for mobile folks from hadoop data in refined tables (Weekly or Daily) to Mobile PM sees reports on browsers (Weekly or Daily).Feb 5 2015, 1:55 AM
kevinator lowered the priority of this task from High to Medium.Feb 12 2015, 2:17 AM
kevinator added a project: good first task.

See also T107175. I'm also eagerly waiting for this. Essentially a user-friendly insight to aggregated information from wmf.webrequest.user_agent_map fields per month over time.

Nuria raised the priority of this task from Medium to High.Oct 5 2015, 4:46 PM
Milimetric renamed this task from Mobile PM sees reports on browsers (Weekly or Daily) to Mobile PM sees reports on browsers (Weekly or Daily) [8 pts].Oct 5 2015, 4:56 PM
Milimetric updated the task description. (Show Details)
Milimetric moved this task from Backlog to Prioritized on the Analytics-Backlog board.
Milimetric moved this task from Prioritized to Tasked on the Analytics-Backlog board.
Nuria renamed this task from Mobile PM sees reports on browsers (Weekly or Daily) [8 pts] to PM sees reports on browsers (Weekly or Daily) [8 pts].Oct 5 2015, 4:57 PM
mforns edited projects, added Analytics-Kanban; removed Analytics-Backlog.
mforns moved this task from Next Up to In Progress on the Analytics-Kanban board.

Let's talk about this cause although item was filed initially for mobile team we probably want a desktop report too. Both should be calculated on pageview data.

How about something like this for mobile (mobile web + mobile app):

os              browser              view_count

iOS 9           Mobile Safari 9         1205334
iOS 8           Mobile Safari 8          845076
Android 4       Android 4                753811
Other -         Other -                  566080
Android 4       Chrome Mobile 45         553635
Android 5       Chrome Mobile 45         481352
iOS 7           Mobile Safari 7          274754
Android 4       Chrome Mobile 38         164416
Android 4       Chrome Mobile 30         161952
Android 5       Chrome Mobile 34         156278

And for everything (desktop + mobile web + mobile app):

os               browser             view_count

Windows 7 -      Chrome 45              2546206
Other -          Other -                1502194
Windows 7 -      IE 11                  1345514
Other -          bingbot 2              1239878
iOS 9            Mobile Safari 9        1217875
Other -          Googlebot 2             993709
Windows 7 -      Firefox 41              960675
iOS 8            Mobile Safari 8         857819
Android 4        Android 4               760881
Windows 8.1 -    Chrome 45               682247

It includes the family and the major of both os and browser. Is that OK? Maybe we need something less granular?

Looks good. Let's please do three changes:

  1. let's not include mobile app, just mobile web on the mobile report and mobile+desktop in the overall.
  2. let's report percentages
  3. let's not include spiders

A couple questions:

  • Do we want the report to be broken down by project?
  • Do we want to filter by project and show Wikipedia only? Or English Wikipedia only?

Change 246851 had a related patch set uploaded (by Mforns):
[WIP] Add oozie job to compute browser usage reports

https://gerrit.wikimedia.org/r/246851

Change 246851 merged by Joal:
Add oozie job to compute browser usage reports

https://gerrit.wikimedia.org/r/246851

kevinator renamed this task from PM sees reports on browsers (Weekly or Daily) [8 pts] to PM sees reports on browsers (Weekly or Daily) {lama} [8 pts].Oct 29 2015, 8:33 PM
kevinator updated the task description. (Show Details)

Is there a wiki page documenting how to see these reports?

@mforns, yes, the distinct fields of OS, OS major, browser family, browser major should be in there. It appears that the job is concatenating OS & OS major and also browser & browser major. I would prefer that we have those as four separate fields instead of two separate fields in order to make pivot table / rollup type reporting more straightforward across those dimensions.

Do I understand correctly that in the future it will be easily possible to be able to chart trendlines against days to see how the numbers fluctuate over time?

For example, we anticipate speed changes would have the impact of, just as an example, increasing the nominal figures Android 2 UAs (and probably by virtue of device deployment distribution on slow networks, the relative share increase would probably be more pronounced). Being able to see how these figures rise and fall will help us to understand impact of changes, as well as of course generally to understand how things are shaping up on the internet in general. I suppose that's obvious, but I figure best to just be explicit about the charting by time piece of it!

@dr0ptp4kt We will be implementing this and other improvements to the browser report format in short, see T126282.