This task is about analyzing how people are engaging with the new Replying tool to:
**Help answer these questions:**
1. Are people are having success using the feature?
2. Are people using the tool in ways that negatively impact the experience of others?
**So we can decide:**
What – if any – changes should be made to the workflow before deploying the feature to more people and with it, beginning an A/B to determine its impact?
=== Workflow engagement metrics
//This section is still being drafted. Once complete, it will continue the information needed make the two decisions listed above.//
**1. Are people publishing the replies they start?**
- % of people who click reply AND who start typing a comment
- % of people who start typing a comment AND who publish their comment to page
**2. Are people abandoning the replies they start?**
- % of people who start typing a comment AND who actively abandon their comment
**3. Are people satisfied with the feature?**
- % of people who publish at least one comment and turn off DiscussionTools in Beta Features
- Of the people who have made at least 1 edit with the Replying workflow, the % of people who posted 1, 2-5, 5-10 and 10+ comments
**4. Are people posting disruptive comments?**
- % of comments posted using Replying workflow that are reverted
- # of people blocked after posting a reply using DiscussionTools
- % of comments posted using Replying workflow that are made in good faith
**5. What text input mode (`source` or `visual`) are people using to publish comments?**
- % of published comments drafted using the `Visual` mode by experience level
- % of published comments drafted using the `Source` mode by experience level
- % of published comments drafted that involved a contributor switching from the `Source` to the `Visual` and vice versa
=== Open questions
- [ ] How long after v2.0 is released should this analysis happen?
- [x] Is new information required to know what text input mode (`source` or `visual`) a user is when they take a certain action (e.g. switching text input modes, abandoning/publishing a comment)?
-- No. For any event in EditAttemptStep we will be able to know what editing input mode (source or visual) the user was in when they took the action.
-- Caveat: the switching event (between source and visual) has not yet been implemented. //See: T247139#6114499//.
- [ ] Analysis is completed that contains the "Workflow engagement metrics" listed above
//This task/analysis, had previously been scoped as a follow up to a then-planned analysis of engagement with Version 1.0: T247138.//