Description
As a way to measure the Metrics Platform's progress in achieving our goals, we determined a set of measurable success criteria:
- decrease the time to data by X%
- decrease the number of custom fields across instruments by X%
- decrease the amount of engineering
dayssteps required to create instruments by X%
We now need to establish tooling or processes to collect this information in an ongoing way as well as establish baselines
User Story
As the Data Products Product Manager
I need to explore data about the current baselines for product team Experiment Owners to get data from beginning to end of the instrumentation process
so I can set achievable goals, establish realistic expectations for our work, and have a starting point from which to tell the story of our team's journey.
As a Senior Product + Tech Leader
I need to view visualized trustworthy empirical data about what the current problems are
so I can ensure we are prioritizing high impact efforts that can produce a reasonable return on investment (ROI)
Outcome
We know at the beginning of the fiscal year:
- How long it takes until Data Analysts can access the data from instruments (time to data)
- How many custom fields exist across all active instruments
- How long it took engineers to create instruments on average across all instruments
And we can easily find out the same data at the end of fiscal year Q1, Q2, and into the future at a quarterly basis.