Page MenuHomePhabricator
Create Task
Maniphest T428265

Revise Tone Structured Task: remove experiment instrumentation and automatic analysis code
Closed, ResolvedPublic2 Estimated Story Points
Actions

Description

Now that the Revise Tone Structured Task A/B test is concluding (T426363), clean up the experiment by removing the instrumentation code and the code that drove automatic analysis, following the Test Kitchen cleanup guidance.

Acceptance criteria

  • Instrumentation/event-logging code specific to the Revise Tone A/B test is removed
  • The automatic analysis code/configuration for the experiment is removed

Notes

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
EventStreamConfig: remove stream used in past experimentsEMcFarlandoperations/mediawiki-configmaster+0 -31
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Experiments Registry: Deregister Growth Experiments Revise Tonerepos/product-analytics/test-kitchen/experiment-analytics-configs!74emc-wmfem/T428265-remove-experiment-instrumentationmain
Customize query in GitLab

Related Objects
Search...

Event Timeline

Michael created this task.Jun 5 2026, 2:12 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 5 2026, 2:12 PM
Michael moved this task from Inbox to Product Backlog on the Growth-Team board.Jun 15 2026, 9:37 AM
Michael added a project: OKR-Work.

(Part of the scaling the Revise Tone task OKR work for next quarter.)

KStoller-WMF triaged this task as Medium priority.Jun 16 2026, 3:20 PM
KStoller-WMF moved this task from Product Backlog to Needs Refinement on the Growth-Team board.
KStoller-WMF moved this task from Needs Refinement to Needs Estimation on the Growth-Team board.Jul 8 2026, 4:51 PM
KStoller-WMF set the point value for this task to 2.Jul 13 2026, 3:48 PM
KStoller-WMF moved this task from Needs Estimation to Estimated tasks backlog on the Growth-Team board.
KStoller-WMF moved this task from Estimated tasks backlog to Up next Sprint on the Growth-Team board.Jul 14 2026, 3:30 PM
KStoller-WMF moved this task from Up next Sprint to FY2026-27 Q1 Sprint 2 on the Growth-Team board.Tue, Jul 14, 4:46 PM
KStoller-WMF edited projects, added: Growth-Team (FY2026-27 Q1 Sprint 2); removed: Growth-Team.
EMcFarland-WMF claimed this task.Wed, Jul 15, 4:20 PM
DMburugu moved this task from Incoming to Doing on the Growth-Team (FY2026-27 Q1 Sprint 2) board.Thu, Jul 16, 12:17 PM
gerritbot added a comment.Fri, Jul 17, 1:04 PM

Change #1311851 had a related patch set uploaded (by EMcFarland; author: EMcFarland):

[operations/mediawiki-config@master] EventStreamConfig: remove stream used in past experiments

https://gerrit.wikimedia.org/r/1311851

gerritbot added a project: Patch-For-Review.Fri, Jul 17, 1:04 PM
CodeReviewBot added a comment.Fri, Jul 17, 1:35 PM

emc-wmf opened https://gitlab.wikimedia.org/repos/product-analytics/test-kitchen/experiment-analytics-configs/-/merge_requests/74

Experiments Registry: Deregister Growth Experiments Revise Tone

EMcFarland-WMF moved this task from Doing to Code Review on the Growth-Team (FY2026-27 Q1 Sprint 2) board.Mon, Jul 20, 11:37 AM
CodeReviewBot added a comment.Tue, Jul 21, 10:24 PM

bearloga merged https://gitlab.wikimedia.org/repos/product-analytics/test-kitchen/experiment-analytics-configs/-/merge_requests/74

Experiments Registry: Deregister Growth Experiments Revise Tone

mpopov subscribed.Tue, Jul 21, 10:30 PM

Deleted experiment from TK AA (with permission):

$ sudo -u analytics-product kerberos-run-command analytics-product spark3-sql -e "DELETE FROM wmf_experiments.experiments_registry_v1 WHERE machine_name = 'growthexperiments-revise-tone';"
$ sudo -u analytics-product kerberos-run-command analytics-product spark3-sql -e "DELETE FROM wmf_experiments.experiment_results_v1 WHERE experiment_machine_name = 'growthexperiments-revise-tone';"

Re-ran load_configurations_daily DAG to pick up the changes from the merged MR.

gerritbot added a comment.Thu, Jul 23, 1:27 PM

Change #1311851 merged by jenkins-bot:

[operations/mediawiki-config@master] EventStreamConfig: remove stream used in past experiments

https://gerrit.wikimedia.org/r/1311851

Stashbot added a comment.Thu, Jul 23, 1:28 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-23T13:28:54Z] <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1311851|EventStreamConfig: remove stream used in past experiments (T428265)]]

Maintenance_bot removed a project: Patch-For-Review.Thu, Jul 23, 1:30 PM
Stashbot added a comment.Thu, Jul 23, 1:31 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-23T13:31:10Z] <kharlan@deploy1003> kharlan, emc-wmf: Backport for [[gerrit:1311851|EventStreamConfig: remove stream used in past experiments (T428265)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Thu, Jul 23, 1:38 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-23T13:38:01Z] <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1311851|EventStreamConfig: remove stream used in past experiments (T428265)]] (duration: 09m 07s)

Michael closed this task as Resolved.Thu, Jul 23, 1:50 PM

The relevant changes have been deployed. I see no errors in https://logstash.wikimedia.org/app/dashboards#/view/41cae700-bfbe-11eb-85b7-9d1831ce7631 and https://grafana.wikimedia.org/d/0352e22b-1ebf-4e13-a97d-4f5f05eb8463/revise-tone-structured-task still works.

So, I think that all ACs are met and I'm closing this as resolved.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits