Page MenuHomePhabricator

Instrumentation Checklist Phab Form
Open, NormalPublic

Description

In Product, we're trying to ensure key processes are followed when projects require data instrumentation or A/B testing. In discussions with Product Managers, it was suggested that a standard Phab form be created that contains the checklist for key processes.


Title Instrumentation Checklist [Project]

Assigned To

Subscribers

Tags Product-Analytics

Description
Instrumentation Checklist (see Data guidelines/Instrumentation checklist for an explanation of each item)

  • Specify why new data is needed
  • Define research questions, metrics, instrumentation data
  • Instrumentation specification ticket and schema definition
  • Schema privacy review
  • Schema creation with backlink to ticket
  • Instrumentation, pipeline scripts (if needed), alerting & monitoring
  • QA Testing
  • Update data dictionary if needed
  • Activate production logging
  • Data verification and fixes
  • Monitor results
  • Long-term Support (LTS)
  • Decommissioning

Event Timeline

kzimmerman updated the task description. (Show Details)Jun 25 2019, 7:32 PM
kzimmerman renamed this task from Instrumentation & Testing Checklist Phab Form to Instrumentation & Checklist Phab Form.Jun 25 2019, 7:58 PM
kzimmerman updated the task description. (Show Details)
kzimmerman renamed this task from Instrumentation & Checklist Phab Form to Instrumentation Checklist Phab Form.Jun 25 2019, 11:24 PM
kzimmerman updated the task description. (Show Details)
kzimmerman updated the task description. (Show Details)Jun 29 2019, 12:25 AM

I hope I'm filing this request properly with the right group; please let me know if I should handle it another way.

Currently the template has a link to a Wiki page that is still blank but will have more information transferred to it.

kzimmerman removed a project: Phabricator.
kzimmerman added a subscriber: MBinder_WMF.

Removing Phabricator for now; I plan to consult @MBinder_WMF about this in our next meeting (not urgent)

kzimmerman triaged this task as Normal priority.Wed, Oct 30, 10:20 PM