Please provide all the following information:

• Context.

The Editing team is currently working on Peacock Check (T365301) as part of Edit Check, based on a model developed by the Research team (contact: @diego) and now being piloted with the ML product team (contact: @SSalgaonkar-WMF).

The objective of this Check is to detect whenever someone is making changes that would be considered to have a promotional tone. As we arrive closer to a release date (by way of an A/B test (T387918)), we are in need of expertise on user tests to help the product teams understand how ready is the proposed user experience for newcomers.

• Description.What is your request about?

Our feature lives in the visual editor and would provide in-context feedback appearing while the changes users are making are considered to be non-neutral (i.e. using a promotional tone). Therefore, our main research question is: How do people respond to/receive unexpected feedback about the tone they were writing in?

• Expected Deliverable. What is the ideal outcome or result of your request?

Hypothesis: If we conduct usability tests of an initial engineered version of Peacock Check with ≥10 newcomers and Junior Contributors and ≥80% of them describe the experience using terms like "helpful," "makes sense," and "clear", then we can be confident the proposed UX has the potential to lower the rate at which the new content edits are reverted on the grounds of WP:WTW (and related policies).

• Estimated Effort. Please provide an estimate of the amount of work needed to complete this task, if known.

Unmoderated tests in Userlytics, and moderated test with a subset of participants for deeper questions and insights for potential UX refinements.

• Priority Please indicate a priority of your task and a small description of what it would unlock for you. We ask you to leave this task as “needs triage” since your request will go through a Backlog refinement process where our team will prioritize the work.

I need this task resolved in:

• 1 month.
• 3 months.
• 6 months.
• Whenever you get to it :-)

• Other. Do you have any other questions or comments ?

We believe this research can have the potential to be defining for Edit Check UX standards beyond the Peacock Check project – as we are expecting the heuristics stemming from it to be transferable to other checks.

Note Due date is set for May 30, 2025 after conversations between Debra and Peter. The sooner this work can conclude the better it is for Peter and team so if there is a way to deliver earlier, please consider it. --Leila