Page MenuHomePhabricator

Clear weighted tag if user reports false positive or on error
Open, HighPublic5 Estimated Story Points

Description

When a user is reporting a false-positive Revise Tone task, then we do not want to keep showing that task to users.

Also, when we encounter an error when requesting the data from DataGateway/Cassandra, e.g. because the data is for an old revision and the page was only just edited, then we also want to remove that article from circulation for the moment.

How a false positive would be reported:

image.png (268×312 px, 16 KB)

In these cases, we need to clear the weighted tag for the Revise Tone task from that page. See LinkRecommendationHelper::deleteLinkRecommendation for how to do that.

In addition to clearing the weighted tag, we also want to log this information to the data-lake, so that we can query it and see which pages come up unusually often. (How to do that?)
In the case where there is an issue with DataGateway/Cassandra, we should also log a warning to logstash, so that we can notice this faster and investigate as needed.

Acceptance criteria

  • if the user marks a Revise Tone Check as a false positive, then the weighted tag for that article is cleared, and this is logged to the Data Lake
  • if the data from DataGateway/Cassandra for an article is missing or out of date, then the weighted tag for that articles is cleared, and this is logged to the Data Lake, and a warning is logged to logstash

Note

Event Timeline

Michael raised the priority of this task from Medium to High.Nov 5 2025, 6:38 PM
Michael set the point value for this task to 5.Nov 10 2025, 11:51 AM

Change #1204605 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@master] feat(ReviseTone): delete weighted tags on missing recommendation

https://gerrit.wikimedia.org/r/1204605

Change #1204606 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@master] feat(ReviseTone): drop weighted tag if tone is fine per user

https://gerrit.wikimedia.org/r/1204606

Change #1204605 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(ReviseTone): drop weighted tag on missing recommendation data

https://gerrit.wikimedia.org/r/1204605

Change #1206412 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@master] fix(ReviseTone): restore modal when task in not available

https://gerrit.wikimedia.org/r/1206412

Change #1206412 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] fix(ReviseTone): restore modal when task in not available

https://gerrit.wikimedia.org/r/1206412

Change #1204606 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(ReviseTone): drop weighted tag if tone is fine per user

https://gerrit.wikimedia.org/r/1204606

This cannot be tested in beta, because we're not relying on weighted tags in the search index there.

It can partially be tested on testwiki after T407029 is done:

  • click on a revise tone task on the homepage
  • in the initial revise tone popup, click "decline" and then "tone is appropriate"
  • go back to the homepage
  • observe that the article is no longer a suggested Revise Tone task
  • IMPORTANT: Go back to the article and make a trivial change. This is needed so that it is parsed by the ML pipeline again and the recommendation is being restored in time

I can confirm that this works on testwiki.

I marked the revise tone on this article as appropriate and I'm no longer seeing it as suggested as the first article. I also made a minor edit to have it parsed by the ML Pipeline again.

You're welcome to close it @Michael