Page MenuHomePhabricator

Build Tone Check Model feedback-based retraining pipeline
Open, Needs TriagePublic

Description

This task involves the work of defining and implementing a process for how the Tone Check model will be retrained.

Story

  • As a new(er) volunteer who is in the midst of making an edit that causes Tone Check to become activated, I want to be confident the feedback I am being offered is aligned with the current state of Wikipedia policies and conventions, so that I can know I am making choices that align with what the people who will be reviewing/moderating/patrolling the edits I'm making expect.
  • As an experienced volunteer who is concerned with ensuring new text that is added to Wikipedia is written in a tone that is aligned with project policies and conventions, I want for the Tone Check model to be perpetually kept in sync with relevant policies and guidelines as they evolve, so that I can be confident the feature is offering people to feedback that is aligned with what I/the project is expecting.

Requirements

To retrain the Tone Check model effectively, the Machine Learning Team will need the following...

  • The text that caused each Tone Check to be shown
  • For each span of text that caused a Tone Check to be shown, whether someone tapped to Revise what they had written or tapped Decline to continue on with what they originally wrote
    • Note: If someone chose to Decline revising, the reason they gave for that specific Tone Check instance.

Background/Links

Event Timeline

Sucheta-Salgaonkar-WMF renamed this task from Build Peacock Model retraining pipeline to Build Tone Check Model feedback-based retraining pipeline.Jul 15 2025, 2:45 PM
Sucheta-Salgaonkar-WMF removed Sucheta-Salgaonkar-WMF as the assignee of this task.
Sucheta-Salgaonkar-WMF moved this task from Watching to Unsorted on the Machine-Learning-Team board.
ppelberg added a subscriber: Esanders.

Today, @Esanders encountered a case that I think the UX/retraining pipeline this task is describing would need to serve.

In the screenshot below, Ed did not think a Tone Check should be activated for this particular case and lacked an affordance for sharing this feedback directly with the model.

image.png (1,287×224 px, 83 KB)