Page MenuHomePhabricator

QA data collection for Incident Reporting System
Closed, ResolvedPublic

Assigned To
Authored By
cchen
Nov 9 2024, 1:20 AM
Referenced Files
F58137082: image.png
Jan 7 2025, 8:46 AM
F58137080: image.png
Jan 7 2025, 8:46 AM
F58137077: image.png
Jan 7 2025, 8:46 AM
F58137070: image.png
Jan 7 2025, 8:46 AM
F58137063: image.png
Jan 7 2025, 8:46 AM
F58137060: Screenshot 2025-01-07 at 2.11.11 AM.png
Jan 7 2025, 8:46 AM
F58137054: image.png
Jan 7 2025, 8:46 AM
F58137044: Screenshot 2025-01-07 at 2.03.23 AM.png
Jan 7 2025, 8:46 AM

Event Timeline

cchen triaged this task as Medium priority.

This is a post-deployment task

@Madalina, I completed post-deployment QA checks and confirmed that all data from the new instrumentation implemented to track the metrics are logged as expected.

Below is a summary of checks and some initial data results from the QA checks for reference. A more detailed analysis of the launch metrics will be completed as part of subsequent analyses.

  • Confirmed all contextual attributes (e.g. page_id, performer_name, session_id, edit_count, language) are logging as expected.
  • Confirmed the user names of reported users are recorded as expected.
  • Confirmed we can calculate all metrics that have been instrumented to date. See below
MetricsResultsStatusNote
Number of Pageviews to the Form107✅ pass
Number of Clicks on Emergency/Non-Emergency Option
image.png (276×838 px, 29 KB)
✅ passFunnels and action context both recorded correctly.
Number of clicks on the “Continue” in "Form" step
Screenshot 2025-01-07 at 2.03.23 AM.png (434×944 px, 63 KB)
✅ passOptions for emergency flow recorded correctly. and NA for non-emergency flows.
Number of Clicks on “Cancel” or “Close”
image.png (662×812 px, 60 KB)
✅ passBoth funnels and corresponding steps recorded correctly. The funnel name is "None" when users don't select any funnels on the first page.
Number of Clicks on the Dropdown Menu Options
Screenshot 2025-01-07 at 2.11.11 AM.png (356×828 px, 39 KB)
✅ passAll dropdown menu options recorded correctly.
Number of Pageviews to the “Submit Report” Step
image.png (178×518 px, 15 KB)
✅ pass
Number of Times Users Enter Text in “Additional Information”1✅ pass
Number of Pageviews to the “Submitted” Step”1✅ pass
Number of Pageviews to the “Describe the incident” Step
image.png (162×524 px, 16 KB)
✅ pass
Number of clicks on the “Continue” in "Describe the incident" step
image.png (676×846 px, 74 KB)
✅ passAll the options in the "Describe the incident" step recorded correctly. "None" for users who clicked the "continue" button without any selections.
Number of Pageviews to the “Get Support” Step
image.png (170×522 px, 16 KB)
✅ pass
Page names of Clicks in the Support Step
image.png (236×942 px, 38 KB)
✅ passPage names recorded correctly. Neither of the two results exceeds the max length.

For detailed queries please refer to this QA notebook.