Page MenuHomePhabricator

Community updates module: instrumentation & measurement
Open, Needs TriagePublic

Description

User story:

As the Growth team, I want to be sure we consider instrumentation & measurement for every feature we release, because we only want to scale out features that improve new editor onboarding and retention.

Parent task: T360485: [EPIC] Newcomer homepage: Community updates module (FY23/24 WE1.3 / FY24/25 SDS2.1.3)

Designs:

Community updates: Figma designs for Homepage module.

Community updates: Figma designs for the configuration form.

What we want to measure:

Leading indicators:

  • Awareness: Total individual views (how many account holders visited their Homepage while this feature was visible)
  • Consideration: Total Click Through Rate
  • Activation: Are account holders who saw this new feature more or less likely to activate.

Lagging indicators:

  • Conversion: After click through, registration for event / program
  • Retention: Are account holders who saw this new feature more or less likely to be retained?
  • Editing high-impact topics: Are account holders who saw this new feature more or less likely to edit "key topic areas" (Related: WE2.1)

Guardrail metrics:

  • CTR & completion rate for Suggested Edits
  • Questions asked to Mentors
  • Page load performance (time to first paint, full page load, etc.)
  • Page load error rates
Measurement & Instrumentation details:

TBD

Acceptance Criteria:

TBD