Page MenuHomePhabricator
Create Task
Maniphest T267496

[SessionLength] Allow data consumers to interact with data related to Session Length
Closed, ResolvedPublic
Actions

Description

Context

To ensure users can query, view and analyze data related to Session Length, this task is scoped to delivering the data set and Superset dashboard to complete the end to end experience. In starting this task, it assumes the work needed for creating and deploying the instrument that tracks users' session data has been completed.

Acceptance Criteria
  • As a technical data consumer, I want to be able to run SQL queries on a database so that I can analyze data related to Session Length
  • As a data consumer, I want to be able to open superset and query session-related data so that I can compose dashboards and reports to view and better understand how session length relates to my other products
Dashboards

Dashboard with production dataset

Related Objects
Search...

Event Timeline

• sdkim created this task.Nov 8 2020, 7:14 PM
• sdkim removed a project: Goal.Nov 9 2020, 4:35 PM
• sdkim moved this task from Inbox to Next on the Product-Data-Infrastructure board.
• sdkim moved this task from Inbox to To Do on the Better Use Of Data board.Nov 9 2020, 4:42 PM
mpopov added a comment.Nov 9 2020, 5:10 PM

Note for triage meeting on Tuesday, Nov 10th: Seve has asked for someone in PA to assist in this task

LGoto assigned this task to kzimmerman.Nov 10 2020, 6:11 PM
LGoto triaged this task as Medium priority.
LGoto moved this task from Triage to Needs Investigation on the Product-Analytics board.
kzimmerman added a comment.Nov 10 2020, 6:12 PM

@sdkim our work on this is going to be in Q3; I'm assigning it to myself for now because I need to look at workloads going into Q3

• sdkim added a comment.Nov 10 2020, 6:45 PM

10-4, thanks @kzimmerman

cchen subscribed.Dec 9 2020, 9:36 PM
kzimmerman moved this task from Needs Investigation to Upcoming Quarter on the Product-Analytics board.Dec 21 2020, 5:27 PM
Mayakp.wiki subscribed.Jan 13 2021, 1:13 AM
• sdkim reassigned this task from kzimmerman to cchen.Jan 27 2021, 7:22 PM
cchen moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.Jan 28 2021, 4:30 AM
cchen moved this task from To Do to Doing on the Better Use Of Data board.Feb 1 2021, 7:04 PM
kzimmerman edited projects, added Product-Analytics (Kanban); removed Product-Analytics.Feb 3 2021, 9:23 PM
kzimmerman moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
cchen added a comment.EditedFeb 10 2021, 4:40 PM

In Superset data table session_length:

  • Add new columns project_family and session_length_bucket
  • Add pre-defined metrics for quantiles

Link to sample dashboard: https://superset.wikimedia.org/r/451

Screen Shot 2021-02-10 at 8.38.50 PM.png (1×2 px, 369 KB)

Screen Shot 2021-02-10 at 8.40.10 PM.png (1×2 px, 398 KB)

NOTES:

  • Since we've include external links like qtm.100ke, gproxx, etc. Maybe we could consider adding project_family (database group) during aggregation instead of querying this in Superset.
  • Currently, we are not sampling the data collection (rate = 1/1). If we decide to change the sampling rate, what's the reliable way to calculate the "count of sessions"? Or should we exclude this metric?
• Mholloway closed subtask T271456: Enable 'skin' dimension using stream configuration as Resolved.Feb 10 2021, 7:07 PM
cchen added a comment.EditedFeb 24 2021, 7:55 PM

Switch the data source for dashboard to session_length_daily table.

Per discussion with Marcel

  • we will do the calculation in Superset for "count of sessions" metrics as an estimation based on the sampling rate. session_count metric was added with current sampling rate = 1/100.
  • in session_length_daily dataset, the external projects are cleanup. So we will query in Superset to get project_family column.
cchen added a comment.Mar 9 2021, 11:11 PM

The sample rate for dashboard was updated to 1/10.

cchen updated the task description. (Show Details)Mar 12 2021, 4:41 AM
cchen added a comment.Mar 12 2021, 2:40 PM

Link to ashboard with production dataset (wmf.session_length_daily): https://superset.wikimedia.org/r/495.

Per conversation with Marcel, we will keep test dataset (mforns.session_length_daily) and sample dashboard for now. And delete both after we have a couple weeks of production data.

kzimmerman closed subtask T271455: Roll-up raw sessionTick data into distribution as Resolved.Mar 13 2021, 12:46 AM
cchen closed this task as Resolved.EditedMar 15 2021, 9:29 PM

Reviewed dashboard with Kate.

NOTES:

Comparing session count in the dashboard with unique devices count on Wiki Stats2 for March 10th:
Unique devices count for en.wiki on Wikistats is ~ 73M
Session count for en.wiki on session dashboard is ~48.9M

This might be related to a delay in session tick 0 from the instrumentation.

cchen reopened this task as Open.Mar 16 2021, 10:35 PM
cchen added a subscriber: mforns.

Reopen this for the optimized intermediate session length data set mentioned in T277512.

@mforns created a testing dashboard (https://superset.wikimedia.org/r/498) with the optimized intermediate table, which reduces the load time from the production dashboard. (Thank you Marcel !!!)

Next step

  • Modify wmf.session_length_daily datasource in Superset with new fields and calculation after updates.
  • QA dashboard again after backfill.
cchen updated the task description. (Show Details)Mar 25 2021, 7:39 PM
cchen added a comment.EditedMar 25 2021, 7:41 PM

Session length dashboard with optimized production data: https://superset.wikimedia.org/r/502

cchen moved this task from Doing to QA/Review on the Better Use Of Data board.Mar 31 2021, 6:14 PM
cchen moved this task from Doing to Needs Review on the Product-Analytics (Kanban) board.Apr 5 2021, 7:27 AM
kzimmerman claimed this task.Apr 13 2021, 5:07 PM
cchen updated the task description. (Show Details)Apr 23 2021, 8:45 PM
kzimmerman closed this task as Resolved.Apr 23 2021, 11:14 PM
kzimmerman reassigned this task from kzimmerman to cchen.
kzimmerman moved this task from QA/Review to Sign-off on the Better Use Of Data board.
kzimmerman updated the task description. (Show Details)
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL