Guardrail metrics are critical to ensure what we're implementing doesn't have any negative consequences.
We need to decide on a few guardrail metrics that will help us understand whether our proposed improvements cause any issues.
Description
Description
Event Timeline
Comment Actions
After discussing with @cchen we have decided on the following guardrail metrics:
1. Sustainable burden on responders
We want the burden of responding to reports to remain sustainable for the emergency team
Metric: number of reports received by the emergency team should stay under 30/day
2. Efficiency of the system
We want to ensure that the system operates efficiently without compromising user experience, usability, or effectiveness. The outcomes we are looking for is a high submission success rate and a low drop-off rate.
Metric 1: at least 80% of initiated reports should be submitted.
Metric 2: no more than 15% of users abandon the form after starting.
Note: submission/drop-off rate refers to reports that users have actually started to write