Page MenuHomePhabricator

Revise Tone Structured Task: Community Configuration
Closed, ResolvedPublic5 Estimated Story Points

Description

As a Wikipedia Admin, I want Revise Tone to be community configurable, so that I decide if the task is available and determine how is should be configured to best meet the needs at my wiki.

Background:

All Suggested Edits are configurable via Special:CommunityConfiguration/GrowthSuggestedEdits

As we release Revise Tone to all wikis supported by the Tone Check model, we should ensure wikis have access to the basic Community Configuration options they need.

Acceptance Criteria:

Given I am on a wiki where Revise Tone is available,
When I visit Special:CommunityConfiguration/GrowthSuggestedEdits,
Then I see a section called Revise Tone.

And within the Revise Tone section:

  1. There is a setting labeled The task is disabled.
    • The setting is unchecked by default.
    • When the setting is checked, the Revise Tone task is not visible or available to users within Suggested Edits.
    • When the setting is unchecked, the Revise Tone task is eligible to be surfaced to users.
  1. There is a configuration field labeled: Articles containing templates defined here will not be shown to users as tasks for this task type.
    • Administrators can define one or more templates to exclude from Revise Tone recommendations.
    • Articles containing any configured template are excluded from the Revise Tone task in Suggested Edits.
  1. There is a configuration field labeled: Articles containing categories defined here will not be shown to users as tasks for this task type.
    • Administrators can define one or more categories to exclude from Revise Tone recommendations.
    • Articles belonging to any configured category are excluded from Revise Tone task generation.

All configuration changes made within the Revise Tone section are saved through Community Configuration and applied to future Revise Tone task recommendations generated.

Event Timeline

KStoller-WMF moved this task from Product Backlog to Needs Refinement on the Growth-Team board.
KStoller-WMF added a subscriber: Urbanecm_WMF.

@Urbanecm_WMF - Should we create subtasks for this work? I'm wondering if this task is ready for estimation.

@Urbanecm_WMF - Should we create subtasks for this work? I'm wondering if this task is ready for estimation.

Thanks for the question and ping! For the first three A/Cs, I think this makes sense as is. Those values are already recognised internally, we "just" haven't added them into the form. We would need to do that (and remove the overrides we added, cf. GEReviseToneExcludedTemplates and GEReviseToneExcludedCategories).

For the fourth A/C, I would split it. The learn more link is not something Revise Tone currently supports, and while we can add it relatively easily, it is a different kind of work that would benefit from being split.

In addition to the A/Cs mentioned in this task, do note there are three other aspects that might be configureable too:

  • the timestamp of the last edit (currently hardcoded to 24 hours),
  • the article creation date (currently hardcoded to 90 days), and
  • the threshold score for the model (currently configurable in server side config, set to 0.8 on all wikis)

Not sure if we would want to add any of those to community configuration. If so, I would probably make those a separate task.

Does this help?

Thanks, yes, that's extremely helpful! I split out the fourth A/C and the additional possible A/Cs into another task: T430380: Revise Tone Structured Task: add more advanced Community Configuration... this might also need to be broken down further, but my hope is that we can complete this task T426690 ASAP, and then consider if anything specified in T430380 is really necessary.

KStoller-WMF raised the priority of this task from Medium to High.Jun 27 2026, 8:36 PM
KStoller-WMF set the point value for this task to 5.

Change #1306919 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@master] feat(Revise Tone): add CommunityConfiguration support

https://gerrit.wikimedia.org/r/1306919

Change #1306919 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(Revise Tone): add CommunityConfiguration support

https://gerrit.wikimedia.org/r/1306919

I can confirm that the form is available on beta but I don't have the admin permissions(though currently seeking them) to save changes and see whether the settings affects the experience.

@KStoller-WMF you could try this out in case I don't get permissions by tomorrow or Thursday.

Screenshot 2026-07-07 at 15.12.19.png (1,680×736 px, 119 KB)

I had to verify on testwiki since beta doesn't have Revise Tone tasks.

I noticed that there's some caching involved between the time when settings are selected and when they apply on the "Select types of edits menu" when it comes to showing the Revise Tone task option. Overall everything seems to align to the settings.

ObservationStateCC Settings
Disabling revise tone doesn't show it as an option in the "Select types of edits menu"
Screenshot 2026-07-07 at 16.09.57.png (1,676×1,778 px, 390 KB)
Screenshot 2026-07-07 at 15.57.01.png (1,680×664 px, 99 KB)
Re-enabling revise tone shows it as an option in the "Select types of edits menu"
Screenshot 2026-07-07 at 15.58.38.png (1,676×1,778 px, 396 KB)
Screenshot 2026-07-07 at 16.11.47.png (1,676×540 px, 90 KB)
Articles in the Categories specified don't show up as revise tone tasks. This Winter Olympics 2026 article no longer shows up as a revise tone suggested edit task as per the setting.Doesn't show as a suggested edit
Screenshot 2026-07-07 at 16.11.47.png (1,676×540 px, 90 KB)
Pages containing the articles specified don't show up as revise tone tasks. This Aiuto:Pagina di discussione article with the template Vedi anche no longer shows up as a revise tone suggested edit task as per the setting.Doesn't show as a suggested edit
Screenshot 2026-07-07 at 16.11.47.png (1,676×540 px, 90 KB)

@KStoller-WMF you can try this out but it looks good to me on testwiki.

Resolving the task - frwiki wmf.10 and enwiki wmf.10 have Revise Tone(Structured task) on Special:CommunityConfiguration. Articles with Revise task look as expected.

The scope of the task is done. The issues found during testing on testwiki wmf.10 will be addressed in T431632: Misconfiguring Revise Tone's Community Configuration can turn off Suggested Edits for everyone.

There are sporadic messages of 500 Internal Server Error https://logstash.wikimedia.org/goto/fb7a7da9d359db59485e6be610fdba77. Those errors had a bump since 2026-06-24, so they are not related to this task (https://logstash.wikimedia.org/goto/a8044bc7932cbb0dfa1889ea4701402d).

message
[fbaf5c5d-9a7c-4bf8-889d-1ed3cfa355d9] /w/index.php?geclickid=[..]gud8&genewcomertasktoken=[...]&gesuggestededit=1&getasktype=revise-tone&section=all&title=Bert_Leatherbarrow&veaction=edit   Wikimedia\NormalizedException\NormalizedException: There was a problem during the HTTP request: 500 Internal Server Error