Page MenuHomePhabricator

Put a Revise Tone task at the front of the queue (till the end of the A/B test)
Closed, ResolvedPublic3 Estimated Story Points

Description

In order to increase the number of editors that interact with the Revise Tone Structured Task during the A/B test, we should put one of it at the front of the queue of tasks on the Homepage.

This should be temporary scaffolding. We do not plan to keep this functionality after the A/B test is over.

Acceptance Criteria:

  • if a user has the Revise Tone task type selected, and we have Revise Tone suggestions available for their selected topics, then we should put a Revise Tone task at the front of the queue of tasks that they see on the homepage

Notes:

  • To limit the scope and complexity, we only focus on the logic that impacts the Homepage upon loading. We do not need to consider changing the post-edit panel logic, nor the logic for loading a new set of tasks when the user edits their topics or task types.
  • Also, the experience for the control group should be unchanged.

Event Timeline

Michael triaged this task as High priority.Oct 20 2025, 3:00 PM
Michael moved this task from Backlog to Current Quarter Backlog on the Growth-Team board.
Michael renamed this task from Put a Revise Tone task at the front of the queue during the A/B test to Put a Revise Tone task at the front of the queue (till the end of the A/B test).Oct 21 2025, 12:08 PM
Michael set the point value for this task to 3.Oct 21 2025, 3:57 PM

Change #1198309 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/GrowthExperiments@master] [DNM][WIP] PoC: ensure a task of a given type id is returned first

https://gerrit.wikimedia.org/r/1198309

Michael moved this task from Incoming to Doing on the Growth-Team (FY2025-26 Q2 Sprint 2) board.
Michael added a subscriber: Sgs.

Change #1200110 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@master] feat(ReviseTone): on homepage, promote ReviseTone or Copyedit tasks

https://gerrit.wikimedia.org/r/1200110

I've updated the description based on the decision to not change the experience for the control group. (See internal conversation)

Change #1200110 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(ReviseTone): on homepage, promote ReviseTone tasks

https://gerrit.wikimedia.org/r/1200110

QA Note: This should be testable beta-enwiki: usually, when having multiple tasks selected on the homepage, it will be random which shows first. But now, if Revise Tone is also selected, then when reloading the homepage a Revise Tone task will always show up first.

Change #1198309 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] ReviseTone: A/B test experiment setup

https://gerrit.wikimedia.org/r/1198309

QA observation:
I'm not able to select a revise tone task type on mobile or desktop. Not sure if it's because I need to self enrol into the experiment or the fact that I'm not in the treatment group.

I have tried logging in and out again but I'm not getting the Revise Tone task type.

Screenshot 2025-11-19 at 15.06.52.png (1×2 px, 447 KB)
Screenshot 2025-11-19 at 15.07.05.png (1×2 px, 252 KB)

I am no longer blocked after @Sgs shared with me a way to add myself to the treatment group. I can now see the Revise Tone task

Screenshot 2025-11-19 at 15.26.26.png (1×2 px, 559 KB)

I'm not seeing any article suggestions when I select the Revise Tone option. Let me know if there's something else I need to enable.

This appears to coincide with the fact that we don't have articles matching hasrecommendation:tone in the search

I created a new account which was added to the treatment group and this does indeed show the revise tone task as the first task regardless of it's initial position in the api pages array.

This works on Mobile and Desktop.

Meets Acceptance Criteria:

I need to confirm whether a user who selects revise tone, unselects it, then reselects it again, is still meant to have revise tone as the first suggestion? I noted that this wasn't the case when I followed that pattern. Reloading the page seems to fix this and set the revise tone as the first task.

I need to confirm whether a user who selects revise tone, unselects it, then reselects it again, is still meant to have revise tone as the first suggestion? I noted that this wasn't the case when I followed that pattern. Reloading the page seems to fix this and set the revise tone as the first task.

No, this was deemed not necessary, as it happens only very rarely. It will only be on the front when the homepage freshly loads, either from navigating to it or from a refresh in the browser.

Thanks for the clarity. We can mark this as passing QA.