[Tone Check] Announce proposed start of A/B Test
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ppelberg
	May 23 2025, 5:45 PM

Description

This task involves the work of sharing the Editing and Machine Learning Teams' plans for running an A/B test of Tone Check.

1. What – if any – concerns/issues about Tone Check (and the A/B test we're planning to help evaluate its impact through) are volunteers holding that we are aligned in thinking need to be addressed before the experiment can proceed?
2. What – if any – facets of how we've documented Tone Check on-wiki could be improved to make it easier for volunteers to assess the experiment proposal we are asking them to review?

Instructions for how volunteers can try the experience
Instructions on how volunteers can identify edits that triggered Tone check (mainly through public tags: T389897, T388716, T395166)
Details about:
- How long we anticipate the test to run (e.g. ecenable=2)
- Who will be included in the test (T389231)
- How we will be evaluating the impact of the intervention
  - E.g. https://www.mediawiki.org/wiki/Edit_check/Tone_Check#Evaluating_impact
- The model: how it was trained and evaluated
Instructions on how to provide feedback
- T393821: Define how volunteers will discuss and provide feedback about Tone Check

Status	Assigned	Task
Open	None	T265163 Create a system to encode best practices into editing experiences
Open	None	T365300 Introduce Edit Checks that encourage behavior aligned with Manual of Style consensus
Open	None	T365301 Tone Check: Prompt people to revise promotional language
Open	None	T416406 [MILESTONE] Offer Tone Check as default-on feature (all wikis)
Open	None	T413026 [MILESTONE] Offer Tone Check as default-on feature at partner wikis
Open	ppelberg	T392954 [FY25-26] WE 1.1: Increase constructive edits
Open	MNeisler	T387918 [MILESTONE] Run an A/B test to evaluate impact of Tone Check
Resolved	Trizek-WMF	T395154 [Tone Check] Announce proposed start of A/B Test