Page MenuHomePhabricator

[Epic] Define Requirements for a Product Team Metrics Framework
Open, Needs TriagePublic

Description

Description

In order to drive innovation with timely data-driven decision making through Metrics Platform’s experimentation capabilities, we need to streamline the metrics collection and analysis process. This tasks captures the work of product team metrics requirements gathering that will define the next phase of work that will:

  • Establish standardized metrics definitions and calculations
  • Ensure compliance with privacy and other data retention policies
  • Reduce manual effort in the experimentation lifecycle
Tasks

(will need subtasks for each item)

  • Create a list of all product team metrics included in annual plan
  • Establish definitions and calculations for all additional product team metrics included in the annual plan
  • Audit all pre-existing product team metrics definitions, calculations, and instruments used to gather those metrics
  • Create a list of all pre-existing product team product health indicators (PHI) and success metrics based on instruments that are active on production and outlined in past measurement plans
  • Note instruments that are on production but are not actively used for PHI or data driven decision making.
  • Document Standard metrics definitions and calculations
  • Establish user segmentation definitions and criteria
  • Audit current data sources and identify gaps
  • Review data retention and deletion policies for blockers or required updates