Page MenuHomePhabricator

Create a plan for moving campaigns-product metrics data to airflow
Open, Needs TriagePublic

Description

Help the campaigns team plan for moving to Airflow. See the slide deck presentation. Once data pipelines are on Airflow, the team can rely on Superset for data dashboards.

  • Identify data categories available (data assets)
  • Identify data to potentially collect within the data assets
  • Test items in the potential collection list that have not been previously utilized in reporting/queries
  • Device data (T367840), Mobile vs desktop (T359112), answers visualization, ambassador action output
  • Review planning on future metrics T365292
  • Request adding special event pages to pageview whitelist
  • Share the plan and work in progress
  • Cross team collaboration & planning
  • Rebecca Maung & Arina
  • Community team(s)
  • Finalize metric list
  • Submit LS3C request as needed
  • Technical planning
  • Resources: Assess the resources required, such as data sources, computational requirements, and external systems that will interact with the pipeline.
  • Workflow: Determine the tasks that need to be automated, their dependencies, and the order in which they should be executed.

WIP Planning Notes Document
Analytics/Systems/Superset
Superset

Event Timeline

Met with @ifried today and talked about the data assets. Here's the preliminary list of potential metrics to track moving forward (which we discussed today):

Registration Tool:

  • Distinct participants registered in period
  • Distinct organizers that joined as organizers in period
  • Number of new accounts created in period
  • New events in period
  • Mobile vs desktop [for engineering &/or design decisions] TESTING NEEDED
  • Devices [for QA purposes; may be satisfied as a preset notebook that QA engineer can run] TESTING NEEDED

Survey data:

  • Age, gender, confidence TESTING/COLAB NEEDED

Event creation data:

  • Event url & page creator name TESTING NEEDED

Event invitations: T365292
Event list:

  • Pageviews
    • To the main page (pageviews) TESTING NEEDED
    • To event pages (referral source tracking) TESTING NEEDED
Iflorez updated the task description. (Show Details)