Page MenuHomePhabricator

[Automated Analytics] Dummy metric for experiments
Closed, ResolvedPublic1 Estimated Story Points

Description

Notes doc: https://docs.google.com/document/d/1roJ9HYfYNNd2jkc6I0XS2SJVKq9A9aqa7wN2tuow-l4/edit?tab=t.6hr8qfhm9y5u

Right now there's a disconnect between experiments that are running and what's in the analytics dashboard. Can we separate those? So that any experiment running on the platform shows up in the dashboard and we have insight into SRM.

Can an experiment be registered without any metrics?

  • Currently checks that at least one metric has been specified
  • None of the metrics for Image Browsing are in the catalog yet.
  • Could be a dummy metric? e.g. "average number of events" which is applicable in every experiment

Acceptance criteria

  • A non-feature-specific metric that can be used to register experiments for automated analysis (e.g. total events collected from user)
  • Currently conducted experiments (image browsing A/B test) that is not yet registered is registered

Details

Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Define 'Events per user' and register Image Browsing A/B test with itrepos/product-analytics/experimentation-lab/experiment-analytics-configs!24bearlogaT409495main
Customize query in GitLab

Event Timeline

mpopov triaged this task as Medium priority.
mpopov renamed this task from []Automated Analytics] Dummy metric for experiments to [Automated Analytics] Dummy metric for experiments.Nov 6 2025, 10:45 PM