This task involves the work of ensuring all of the metrics specified within the Suggestion Mode MVP controlled experiment measurement plan are implemented within the Test Kitchen metrics catalog.
Open question(s)
- 1. Will people who are logged in and published ≥100 cumulative edits be included in the experiment? If so, we'll need to update the metric definitions to explicitly exclude anyone NOT in these groups.
- This is being discussed in Slack here
Requirements
- Review the metrics specified in the Suggestion Mode MVP controlled experiment measurement plan
- Identify what (if any) metrics are not yet implemented within the Test Kitchen metrics catalog
- For any metrics that are not yet implemented within the Test Kitchen metrics catalog, define and implement them
Done
- All Requirements are addressed
Note: this task being resolved does not need to block the start of the controlled experiment. Although, until this work is completed, all metrics specified within the measurement plan will not be available within Superset.