This task involves the work of implementing a proof of concept for the ML-backed Peacock Check (T379397) so that we can:
- Encounter and confront UX questions/issues that still need to be addressed and ultimately, validate the usability of the experience via T383956
- Evaluate what – if anything – about the Peacock detection model might need to be adjusted in order to enable the UX
Stories
- As an experienced volunteer/moderator motivated to ensure that Wikipedia offers people that is impartial, I want everyone contributing new text content in the main namespace to make an effort to ensure people encountering the information they are contributing will perceive it as neutral so that I am relieved of the burden of doing so myself.
- As someone who is new and motivated to contribute – what I consider to be – valuable + missing knowledge to Wikipedia, I want to know what I'm contributing adheres to relevant policies and conventions, so that I, and other people, can access this knowledge across time.
Requirements
The requirements that follow are drawn from Peacock Check/Requirements and Peacock, Feb 2025 (Figma)...
Meta
- Platforms: Mobile + Desktop
- Model: this proof of concept ought to be built in a way that it will be relatively straightforward to integrate the peacock language ML model when it's ready (late-March/early-April)
Detection (Mid-Edit)
Determine the presence/absence of peacock language...
- Within < 500ms of someone finishing adding a new sentence/paragraph to a Wikipedia article (NS:0) that we are ≥90% sure contains peacock language present a Peacock Check card
Awareness + Understanding (Mid-Edit)
People are aware of what they have done/are doing that needs their attention and why...
- The moment when the interface makes people aware that what they've written warrants additional attention will be the same on mobile and desktop; however, how the Peacock Check card is presented will vary by platform
- On mobile, a visual hint will appear in the rail that exists alongside the editable surface. When tapped, the Peacock Check card will be expanded (T383955)
- On desktop, the Peacock Check card will appear in the sidebar that exists alongside the editable surface. This card will contain:
- Information that the software detected peacock/non-neutral language within the text you added
- Information about why the presence of this language/tone is worth you allocating attention to.
- E.g. Edits without non-neutral tone are ##% more likely to be approved (copy TBD).
- Choices/calls to action to address the issue. See "Action" below.
- The sentence(s) that the system has detected peacock language within ought to be highlighted and vertical yellow'ish bar will appear to further accentuate the text the system has detected Peacock language within
Action (Mid-Edit)
People are equipped with the tool(s)/affordance(s) to neutralize the tone of what they've written or explicitly decide not to and express why
- Within the mobile and desktop Peacock Check cards, people will be met with the following choices:
- A way to fix/address the tone issue the software has detected by tapping Revise. Upon tapping Revise:
- Peoples' cursor ought to be placed at the very beginning of the text they added, and the system has detected Peacock Check language within. Note: on mobile keyboard should appear.
- The text they originally wrote will remain highlighted, with the vertical yellow'ish bar still appearing beside it
- A way to decline addressing the tone issue the software has detected by tapping Dismiss
- Note: button label will likely change. We may also specify something else to show if/when people select this choice.
- A way to collapse/defocus the Peacock Check card and bypass taking action on it during the "Mid-Edit" moment. Related: T386932.
- A way to expand/refocus a Peacock Check card you had previously elected to collapse/defocus in the "Mid-Edit" moment. Related: T386932.
- Any Peacock Check(s) that someone has not engaged with during the Mid-Edit moment should be re-presented during the Pre-Save moment with the same calls to action defined above
- When someone revises a span of text that had caused the Peacock Check to activate, the model ought to re-check the text to evaluate the extent to which peacock/non-neutral language is still present.
- A way to fix/address the tone issue the software has detected by tapping Revise. Upon tapping Revise:
Revisit (Pre-Save)
People are reminded to engage with Peacock Checks they did not address in the Mid-Edit moment.
- Any Peacock Check that people did not explicitly engage with, by either tapping Revise or Dismiss, ought to be re-presented in the Pre-Save moment using Edit Check's "focus mode". Read: Checks shown one at a time, "stepper" to navigate between Checks, etc.
- If someone taps Revise:
On mobile, they ought to be taken to an editable surface where:Said text ought to be highlighted
Only the text the Peacock Check is relevant to is shown/availableThe mobile VE editing tools are shown, flanked by < and > navigation buttons on either sideThe > button ought to be deactivated until someone changes the text in somewayIf someone where to tap < they ought to be taken back to the Pre-Save mode with the Peacock Check relevant to the text they were just viewing exposedOnce someone changes the text, the > will become activated and they'll be taken to one of two places:If unaddressed Checks do NOT remain, they'll proceed to the edit summaryIf unaddressed Checks do remain, they'll proceed back to the Pre-Save focus mode with any remaining Check(s) displayed
- On desktop and mobile, they ought to be taken to the full editable surface
- Upon arriving, they will see:
- The text highlighted
- The full VE editing toolbar will appear
- The Publish Changes button ought to be deactivated until someone changes the text in someway
- OPEN: will the Peacock Check "card" appear? What about the other unaddressed Checks?
- Upon arriving, they will see:
- Once someone changes the text, the Publish Changes button will become activated and they'll be taken to one of two places:
- If unaddressed Checks do NOT remain, they'll proceed to the edit summary
- If unaddressed Checks do remain, they'll proceed back to the Pre-Save focus mode with any remaining Check(s) displayed
- OPEN: how might someone navigate back to the Pre-Save moment from here?