Page MenuHomePhabricator
Create Task
Maniphest T394939

Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the results
Closed, ResolvedPublic2 Estimated Story Points
Actions

Description

After we have collected the amount of data we would like to have, we need to decommission the experiment.

The data will be in a hive table for analysis.

Acceptance Criteria:

  • Data for analysis
  • Experiment code removed
  • Experiment turned off

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
Decommission RecentChanges/Watchlist/RelatedChanges experiment and convert to instrumentationKgraesslemediawiki/extensions/WikimediaEventsmaster+140 -224
Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the resultsKgraesslemediawiki/coremaster+0 -117
Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the resultsKgraesslemediawiki/extensions/WikimediaEventsmaster+0 -247
Customize query in gerrit

Related Objects
Search...

Event Timeline

• Kgraessle created this task.May 21 2025, 4:05 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 21 2025, 4:05 PM
• Kgraessle moved this task from Inbox to To be estimated on the Moderator-Tools-Team board.May 22 2025, 5:09 PM
• Scardenasmolinar set the point value for this task to 2.Jun 10 2025, 3:11 PM
• Scardenasmolinar moved this task from To be estimated to Estimated on the Moderator-Tools-Team board.
• Kgraessle added a parent task: T396789: [Epic] Run and analyse an experiment for the group by toggle for Watchlist/RecentChanges/RelatedChanges.Jun 17 2025, 2:02 PM
• Kgraessle updated the task description. (Show Details)Jun 17 2025, 3:11 PM
• Kgraessle renamed this task from Decommission RecentChanges experiment platform instrument and analyze the results to Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the results .Jun 17 2025, 3:17 PM
• Kgraessle claimed this task.Aug 28 2025, 2:20 PM
• Kgraessle triaged this task as Low priority.
• Kgraessle moved this task from Estimated to Kanban on the Moderator-Tools-Team board.
• Kgraessle edited projects, added: Moderator-Tools-Team (Kanban); removed: Moderator-Tools-Team.
• Kgraessle moved this task from Ready to In Progress on the Moderator-Tools-Team (Kanban) board.
gerritbot added a comment.Aug 29 2025, 6:05 PM

Change #1183162 had a related patch set uploaded (by Kgraessle; author: Kgraessle):

[mediawiki/extensions/WikimediaEvents@master] Decommission RecentChanges/Watchlist/RelatedChanges experiment and convert to instrumentation

https://gerrit.wikimedia.org/r/1183162

gerritbot added a project: Patch-For-Review.Aug 29 2025, 6:05 PM
• Kgraessle moved this task from In Progress to Eng review on the Moderator-Tools-Team (Kanban) board.Aug 29 2025, 6:07 PM
• Kgraessle added a subscriber: • JWheeler-WMF.Aug 29 2025, 6:11 PM

I don't think we'll be able to re-use much, if any of this code for the dashboard experimentation since the ux will be so different in our new interface.
However, I did convert the page visit, and CTR to each change link from an experiment to an instrument so that we can continue to measure these on an ongoing basis if we'd like to.

I'm not sure if this work is being tracked anywhere else, @JWheeler-WMF, this may be helpful for your team's work on the instrumentation of Watchlist.

Samwalton9-WMF mentioned this in T402747: Recent changes's "view new changes" can cause odd wrapping at some viewport widths.Sep 2 2025, 4:06 PM
• Kgraessle moved this task from Eng review to In Progress on the Moderator-Tools-Team (Kanban) board.Sep 2 2025, 7:06 PM
• Kgraessle changed the task status from Open to Stalled.Sep 2 2025, 7:16 PM
• Kgraessle added subscribers: OTichonova, Samwalton9-WMF.

@OTichonova, @Samwalton9-WMF

Do we want to just outright remove the toggle when the experiment is over or do we want to potentially keep the toggle around if our experiment shows that we have higher click through rates?

Samwalton9-WMF added a comment.Sep 3 2025, 5:41 PM

Let's aim to outright remove it and then we can revisit how best to proceed once we've looked at the data.

• Kgraessle changed the task status from Stalled to Open.Sep 3 2025, 7:48 PM
gerritbot added a comment.Sep 3 2025, 8:29 PM

Change #1184586 had a related patch set uploaded (by Kgraessle; author: Kgraessle):

[mediawiki/core@master] Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the results

https://gerrit.wikimedia.org/r/1184586

• Kgraessle moved this task from In Progress to Eng review on the Moderator-Tools-Team (Kanban) board.Sep 3 2025, 8:29 PM
gerritbot added a comment.Sep 12 2025, 2:44 PM

Change #1187833 had a related patch set uploaded (by Kgraessle; author: Kgraessle):

[mediawiki/extensions/WikimediaEvents@master] Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the results

https://gerrit.wikimedia.org/r/1187833

• Kgraessle added a comment.Sep 12 2025, 2:50 PM

Ok, I have a few patches as a part of this phab ticket, so I'm just posting which ones need to be merged to completely decommission this experiment:

Patch to completely remove experiment module from WikimediaEvents extension
Patch to completely remove the group by toggle from core

After turning the experiment off, none of this code should be reachable so there shouldn't be any need to care about the order in which these deploy on the train, but it would probably make sense to remove the toggle from core first.

• Scardenasmolinar moved this task from Eng review to QA on the Moderator-Tools-Team (Kanban) board.Sep 18 2025, 5:54 PM
gerritbot added a comment.Sep 18 2025, 6:16 PM

Change #1184586 merged by jenkins-bot:

[mediawiki/core@master] Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the results

https://gerrit.wikimedia.org/r/1184586

gerritbot added a comment.Sep 18 2025, 6:21 PM

Change #1187833 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Decommission RecentChanges/Watchlist/RelatedChanges experiment and analyze the results

https://gerrit.wikimedia.org/r/1187833

ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.20; 2025-09-23).Sep 18 2025, 7:01 PM
jsn.sherman closed this task as Resolved.Sep 24 2025, 6:47 PM
jsn.sherman moved this task from QA to Done on the Moderator-Tools-Team (Kanban) board.
jsn.sherman subscribed.

verified on enwiki

gerritbot added a comment.Oct 3 2025, 6:23 PM

Change #1183162 abandoned by Kgraessle:

[mediawiki/extensions/WikimediaEvents@master] Decommission RecentChanges/Watchlist/RelatedChanges experiment and convert to instrumentation

Reason:

not necessary

https://gerrit.wikimedia.org/r/1183162

Maintenance_bot removed a project: Patch-For-Review.Oct 3 2025, 6:31 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits