Page MenuHomePhabricator

Add option to Tone Check decline survey for quotes
Open, Needs TriagePublic

Description

In T389443, we implemented the initial Tone Check decline survey that offers people the following choices to explain why they have opted not to revise the Tone when prompted:

  1. The tone is appropriate
  2. I'm not sure how to revise the tone
  3. Other

This task involves the work of adding a response to that survey (described below).

This suggestion is a response to the ML and Growth Teams coming to learn via T401968 that there are likely to be cases when the Tone Check model suggests that people revise the tone of a direct quote which is not aligned with what Wikipedia policy prescribes.

  • In an internal review of enwiki suggestions, approximately 30% of suggestions included direct quotes. The Growth and Machine Learning teams plan to implement improvements to better filter out these cases. However, because the formatting of quotations on wiki varies widely, it is unlikely that all direct quotes can be excluded.

Story

As a newcomer who is being prompted to revise the tone of text I've added to an article (or someone else did previously), I want to be able to decline doing so in cases where the text in question includes a direct quote so that I can make edits that align with Wikipedia policies and demonstrate this intention to other editors who might be reviewing this choice I've made.

Requirements

  1. Add – what would become – a fourth option within the decline survey that reads: “This text is part of a direct quote”
    1. Note: the Other response should continue to appear as the bottom-most option in the decline survey.

NOTE: the Editing Team will prioritize work on this task after T387918 concludes

Event Timeline

For reference, copying an offline comment I made about the possibility of the feature helping users who come across improperly formatted quotes to correct them:

One thing that Suggested Tasks seem very good at doing is finding unusually formatted quotes. Some of these adhere to editorial guidance but just have niche forms/markup that we can try to teach our models to avoid. But many others (like this or this) are in a bucket where there's no proper markup or no markup at all setting them apart from the body text.

This is bad for multiple reasons. The lack of any sort of quote syntax hinders the display, sometimes to the point where readers may have trouble distinguishing the quote from wikivoice material. And it means that they're likely to show up not only for our initial Revise Tone suggested task, but also for others in the future and for other kinds of automated editing like AutoWikiBrowser runs (it excludes quotes it can recognize from many find-and-replace tasks), so the problem will only get worse as this kind of editing gains steam.

Given this, I wonder if it might make sense to shift from a perspective of just trying to get these unmarked quotes out of our way to one that views identifying and fixing them as a significant benefit in and of itself. I could envision a more developed version of Suggested Tasks in the future that, when you identify a suggestion as actually part of a quote, guides you through the process of adding proper quote formatting around it. Over time, this might reduce the number of unmarked quotes until eventually they're eliminated.

I just wanted to note that although the model is doing better at filtering out quotes from Revise Tone suggestions, we are still running into cases where quotes get suggested.

I think it would be ideal if there was a fourth option within the decline survey that reads: “This text is part of a direct quote”. This could help reinforce for newcomers that they shouldn't revise text within quotations.

Screenshot 2026-03-18 at 2.22.40 PM.png (2,666×1,124 px, 509 KB)

It might also be interesting to eventually explore the idea @Sdkb suggest above too: what if we eventually used this metadata to create a new suggestion to review the formatting of the quotation?

Esanders subscribed.

Ideally we could do a better job of filtering out quoted content in the client (we already do some). I've filed T426362 with some suggestions.

Here is a possible solution for this:

  1. The user would see the Revise Tone check
  2. Then, if they select Decline they would see the decline survey with the "This text is part of a direct quote" option first.
    • Note that the "Other" option was previously rephrased to "None of the above applies" in all decline surveys.
  3. If the user selects "This text is part of a direct quote", that text could automatically be converted into a Block quote, with Toast explaining that.
    • Note that on mobile there is no way to include text formatting at the moment (unless we work on T423150). So we should decide on this.

image.png (3,605×988 px, 589 KB)

The same flow could also apply to Paste Check since a paste text could also be a quote.

image.png (3,605×1,025 px, 608 KB)

We need to decide if we want to add this option, or just fix the issue with quotes via T426362

bmartinezcalvo subscribed.

We need to decide if we want to add this option, or just fix the issue with quotes via T426362

Removing me from assigned until we solve this.