Page MenuHomePhabricator

Create a schema to track experiment exposure analytics events
Open, Needs TriagePublic3 Estimated Story Points

Description

Background

An experiment can have two or more variations, e.g. control and A, control and A, B, and C, etc.

We want to be able to answer the following questions about an experiment and its variations:

  1. How many times have users been exposed to one of the experiment variations?
  2. How many unique users have seen one of the experiment variations?
  3. Are users being assigned the experiment variations according to the assignment configuration?

Proposal

In order to answer the above, we propose the following event shape:

interface ExperimentExposureEvent {
  timestamp: string; // ISO 8601 formatted timestamp
  userToken: string;
  experimentID: string;
  experimentFriendlyName: string;
  experimentVersion: string;
  experimentUpdated; string; // ISO 8601 formatted timestamp
  variationID: string;
  variationFriendlyName: string;
}

AC

  • The proposal is validated
  • We determine whether an event shape (or a partial event shape) like in the proposal can be exported to GrowthBook
  • (Optional) A JSONSchema Event Platform schema is created

Requirements

  • Documentation?