≥2 weeks after starting of the Paste Check A/B Test (T399669), we will check on a set of leading indicators (outlined below).
We will use this ticket to scope and conduct this analysis.
=== Analysis timing
!!TBD!!
=== Decision(s) to be made
- [ ] What – if any – adjustments/investigations will we prioritize for us to be confident moving forward with evaluating the Tone Check's impact in T399669?
=== Leading indicators
WARNING: Need to discuss with @MNeisler
//Metrics//
|ID|Name|Owner|Metric(s) for Evaluation | Conclusion
|---|---|---|---|---
|1.|Newcomers and Junior Contributors are not encountering Paste Check | Editing | Proportion of new content edits Paste Check is shown within|
|2.|Newcomers and Junior Contributors are not understanding the feature| Editing| Proportion of contributors that are presented Paste Check and abandon their edits|
|3.|People deem Paste Check irrelevant| Editing |Proportion of edits wherein people elect to dismiss/not change the text they've added|
|4.|Pastae Check is causing disruption| Editing| **1)** Proportion of people blocked after publishing an edit where Paste was shown //and// **2)** Proportion of published edits that add new content and are reverted within 48hours|