Prior to deploying the Replying tool to //all// volunteers at our four partner wikis (T249394), we would like to know how the tool is being used/adopted as a Beta Feature.
Reason being: we would like to decide whether the jump in usage we can anticipate between the feature being available as an opt-in Beta Feature and it being available as an opt-out user Preference is large enough to warrant us taking an intermediate deployment step. [2]
To help evaluate the "usage/adoption" we would like to understand the following "Adoption metrics."
=== Adoption metrics
//For each of our four partner wikis – Arabic, Dutch, French and Hungarian – we would like to know the following...//
**How many people should we expect to try the Replying feature when it is turned on as an opt-out user preference at our four partner wikis?**
- Upper bound: number of people who have made at least 1 edit, in any namespace, in the previous 30 day period
- Lower bound: number of people who have made at least 1 edit in a talk namespace in the previous 30 day period
**From 31-March-2020 onward, how has the version 1.0 of the Replying feature been adopted?**
- How many people have explicitly [3] turned on the Beta Feature?
- How many people have turned off the Beta Feature?
**From 31-March-2020 onward, how intensely are people using version 1.0 of the Replying feature?**
- How many people have made 1 edit w/ DiscussionTools?
- How many people have made 2-5 edits w/ DiscussionTools?
- How many people have made 5-10 edits w/ DiscussionTools?
- How many people have made 10+ edits w/ DiscussionTools?
- [Nice to have] Of the people who have made at least one edit with Replying tool, how many of these have made >10%, >25% and >50% of their talk page edits using it after turning on the feature?
=== Timing
Q4/2019-2020
=== Done
- [ ] The "Adoption metrics" above have been calculated
- //Once the initial report is created, ideally, the Editing Team will be able to re-run these queries independent of #product-analytics.//
---
1. https://www.mediawiki.org/wiki/Talk_pages_project/replying#Step_3:_User_Preference_(opt-out)
2. **Intermediate deployment step:** e.g. deploying the feature as an opt-out user Preference to 50% of contributors on target wikis.
3. **"Explicitly"**: meaning they //did not// have the following preference checked: `Automatically enable all new beta features`