Page MenuHomePhabricator

Expand interface customization spec with new metrics
Closed, ResolvedPublic

Description

Background

See T345001: Create instrumentation spec for establishing baseline for interface customization After discussing with the team, we identified additional customizations which are available to readers

Acceptance criteria

Evaluate which of the following metrics are currently instrumented:

  • % of pageviews which a viewing a pinned/unpinned version of the menus on the site (main menu, table of contents, tools menu)
  • % of pageviews which have disabled media viewer

Add missing metrics to instrumentation spec

Next steps in data process (bolding indicates step we are currently on):

PM and Data Analyst coordinate to identify experiment design, research questions, metrics and guardrails for the new feature and associated metrics.
Data analyst creates a list of events that need to be tracked to calculate each metric
Engineers review the event list and comment on whether we’re already tracking with existing instruments and if new instrumentation is required. New tickets created for any new instrumentation needed.
Data analyst works with engineers to figure out what the new instrumentation should look like and where to store the events.
Data analyst documents all of the above in the instrumentation spec
PM signs off on the plan
Legal & Security sign off on the plan

Instrumentation Spec

Documentation: Instrumentation Spec

Event Timeline

ovasileva moved this task from Incoming to Analyst Consultation on the Web-Team-Backlog board.

Delivery

  • Propose "Event to be tracked" in the instrumentation spec based on PM's question list.
  • Propose schema field name and value for each event, and documented in instrumentation spec .

See the baseline collection 4 and baseline collection 5 in Instrumentation Spec

All done, resolving.