Page MenuHomePhabricator
Create Task
Maniphest T439887

Recommended Reading exp: Align Reader pageview metric for control
Open, HighPublic1 Estimated Story Points
Actions

Description

Background

In de-1-3-1-specialhomepage-onboarding-ab-test, the event welcome_survey_account_setup_motivation_saved uses different action_context values per group:

  • Treatment (AccountSetup): reading, editing, both, skipped
  • Control (Welcome Survey): the raw reason answer, e.g. read; no event when skipped

So readers in control can't be identified the same way as readers in treatment.

Goal

Make the control group send the same action_context values as the treatment group.

Welcome Survey reference: P7829

Acceptance criteria for done

  • Control maps reason to reading, editing, other or skipped.
    • read → reading
    • edit-typo, edit-info-add-change, add-image, new-page, program-participant → editing
    • no answer (placeholder) → skipped
  • Control sends the event with skipped when the survey is skipped.
  • PHPUnit tests cover the mapping and the skip case.

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
instrument(AccountSetup): expose motivation data for controlVolkerEmediawiki/extensions/WikimediaEventswmf/1.47.0-wmf.22+47 -2
instrument(AccountSetup): expose motivation data for controlVolkerEmediawiki/extensions/WikimediaEventsmaster+47 -2
instrument(WelcomeSurvey): align motivation event with AccountSetupVolkerEmediawiki/extensions/GrowthExperimentswmf/1.47.0-wmf.22+101 -13
instrument(WelcomeSurvey): align motivation event with AccountSetupVolkerEmediawiki/extensions/GrowthExperimentsmaster+101 -13
Customize query in gerrit

Related Objects
Search...

Event Timeline

Volker_E created this task.Thu, Oct 1, 3:49 PM
Restricted Application added a project: Growth-Team. · View Herald TranscriptThu, Oct 1, 3:49 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
gerritbot added a comment.Thu, Oct 1, 3:52 PM

Change #1347673 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/GrowthExperiments@master] instrument(WelcomeSurvey): align motivation event with AccountSetup

https://gerrit.wikimedia.org/r/1347673

gerritbot added a project: Patch-For-Review.Thu, Oct 1, 3:52 PM
gerritbot added a comment.Thu, Oct 1, 5:31 PM

Change #1347673 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] instrument(WelcomeSurvey): align motivation event with AccountSetup

https://gerrit.wikimedia.org/r/1347673

gerritbot added a comment.Thu, Oct 1, 5:44 PM

Change #1347712 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/GrowthExperiments@wmf/1.47.0-wmf.22] instrument(WelcomeSurvey): align motivation event with AccountSetup

https://gerrit.wikimedia.org/r/1347712

ReleaseTaggerBot added a project: MW-1.47-notes (1.47.0-wmf.23; 2026-10-06).Thu, Oct 1, 6:00 PM
Volker_E added a parent task: T437339: Recommended reading exp: Instrument user interaction on module.Thu, Oct 1, 7:30 PM
Jdlrobson-WMF assigned this task to Etonkovidova.Thu, Oct 1, 8:10 PM
Jdlrobson-WMF set the point value for this task to 1.
Jdlrobson-WMF moved this task from Ready to Needs QA on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.
gerritbot added a comment.Thu, Oct 1, 8:14 PM

Change #1347712 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@wmf/1.47.0-wmf.22] instrument(WelcomeSurvey): align motivation event with AccountSetup

https://gerrit.wikimedia.org/r/1347712

Stashbot added a comment.Thu, Oct 1, 8:14 PM

Mentioned in SAL (#wikimedia-operations) [2026-10-01T20:14:28Z] <cjming@deploy1003> Started scap sync-world: Backport for [[gerrit:1347606|fix(ReadingRecommendations): Update button style to primary (T436332)]], [[gerrit:rEDOI13477127b80e|instrument(WelcomeSurvey): align motivation event with AccountSetup (T439887)]], [[gerrit:1347743|instrument(AccountSetup): Record setup motivation on page_visit (T439217)]]

Stashbot mentioned this in T439217: Make `homepage` (Special:Homepage) identifiable in `page_visit` events.Thu, Oct 1, 8:14 PM
Stashbot mentioned this in T436332: Recommended reading exp: Final design review and adjustments for recommended articles.
Stashbot added a comment.Thu, Oct 1, 8:18 PM

Mentioned in SAL (#wikimedia-operations) [2026-10-01T20:18:22Z] <cjming@deploy1003> cjming, volker-e: Backport for [[gerrit:1347606|fix(ReadingRecommendations): Update button style to primary (T436332)]], [[gerrit:rEDOI13477127b80e|instrument(WelcomeSurvey): align motivation event with AccountSetup (T439887)]], [[gerrit:1347743|instrument(AccountSetup): Record setup motivation on page_visit (T439217)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can

Maintenance_bot removed a project: Patch-For-Review.Thu, Oct 1, 8:31 PM
Stashbot added a comment.Thu, Oct 1, 8:32 PM

Mentioned in SAL (#wikimedia-operations) [2026-10-01T20:32:57Z] <cjming@deploy1003> Finished scap sync-world: Backport for [[gerrit:1347606|fix(ReadingRecommendations): Update button style to primary (T436332)]], [[gerrit:rEDOI13477127b80e|instrument(WelcomeSurvey): align motivation event with AccountSetup (T439887)]], [[gerrit:1347743|instrument(AccountSetup): Record setup motivation on page_visit (T439217)]] (duration: 18m 28s)

Jdlrobson-WMF triaged this task as High priority.Thu, Oct 1, 8:58 PM
ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.22; 2026-09-29); removed: MW-1.47-notes (1.47.0-wmf.23; 2026-10-06).Thu, Oct 1, 9:01 PM
ldelench_wmf added a project: OKR-Work.Fri, Oct 2, 1:55 PM
gerritbot added a comment.Fri, Oct 2, 5:03 PM

Change #1348834 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/WikimediaEvents@master] instrument(AccountSetup): expose motivation data for control

https://gerrit.wikimedia.org/r/1348834

gerritbot added a project: Patch-For-Review.Fri, Oct 2, 5:03 PM
Volker_E removed Etonkovidova as the assignee of this task.Fri, Oct 2, 5:12 PM
Volker_E moved this task from Needs QA to Needs code review on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.
Volker_E added a subscriber: Etonkovidova.
gerritbot added a comment.Sat, Oct 3, 7:33 AM

Change #1348834 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] instrument(AccountSetup): expose motivation data for control

https://gerrit.wikimedia.org/r/1348834

ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.23; 2026-10-06); removed: MW-1.47-notes (1.47.0-wmf.22; 2026-09-29).Sat, Oct 3, 8:00 AM
Maintenance_bot removed a project: Patch-For-Review.Sat, Oct 3, 8:31 AM
gerritbot added a comment.Sat, Oct 3, 5:35 PM

Change #1350233 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] instrument(AccountSetup): expose motivation data for control

https://gerrit.wikimedia.org/r/1350233

gerritbot added a project: Patch-For-Review.Sat, Oct 3, 5:35 PM
gerritbot added a comment.Mon, Oct 5, 11:42 AM

Change #1350233 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.22] instrument(AccountSetup): expose motivation data for control

https://gerrit.wikimedia.org/r/1350233

Stashbot added a comment.Mon, Oct 5, 11:42 AM

Mentioned in SAL (#wikimedia-operations) [2026-10-05T11:42:58Z] <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1350233|instrument(AccountSetup): expose motivation data for control (T439887)]]

ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.22; 2026-09-29); removed: MW-1.47-notes (1.47.0-wmf.23; 2026-10-06).Mon, Oct 5, 12:00 PM
Stashbot added a comment.Mon, Oct 5, 12:01 PM

Mentioned in SAL (#wikimedia-operations) [2026-10-05T12:01:19Z] <lucaswerkmeister-wmde@deploy1003> volker-e, lucaswerkmeister-wmde: Backport for [[gerrit:1350233|instrument(AccountSetup): expose motivation data for control (T439887)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Maintenance_bot removed a project: Patch-For-Review.Mon, Oct 5, 12:31 PM
Stashbot added a comment.Mon, Oct 5, 12:38 PM

Mentioned in SAL (#wikimedia-operations) [2026-10-05T12:38:24Z] <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1350233|instrument(AccountSetup): expose motivation data for control (T439887)]] (duration: 55m 26s)

DMburugu moved this task from Inbox to Triaged on the Growth-Team board.Mon, Oct 5, 1:12 PM
Volker_E moved this task from Needs code review to Needs QA on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.Mon, Oct 5, 5:04 PM
Jdlrobson-WMF assigned this task to Etonkovidova.Mon, Oct 5, 5:14 PM
Volker_E moved this task from Backlog / Post-Experiment to Priority I / REx Sprint 7 on the FY26-27 DE 3.2.2 Article recommendations board.Tue, Oct 6, 2:53 PM
HFan-WMF edited projects, added: Reader Experience Team (REx Sprint 8 (Q2 FY26-27 Oct 6-19)); removed: Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5).Tue, Oct 6, 10:42 PM
HFan-WMF moved this task from Ready to Needs QA on the Reader Experience Team (REx Sprint 8 (Q2 FY26-27 Oct 6-19)) board.
Etonkovidova moved this task from Needs QA to Sign-off on the Reader Experience Team (REx Sprint 8 (Q2 FY26-27 Oct 6-19)) board.EditedThu, Oct 8, 10:22 PM

Tested on https://test.wikipedia.org/wiki/Special:WelcomeSurvey - all mapping for a control group (with Special:WelcomeSurvey) seem to be correct:

mw.testKitchen.overrideExperimentGroup( 'de-1-3-1-specialhomepage-onboarding-ab-test', 'control' );

This is just an example of events when selecting a reason on Special:WelcomeSurvey that falls into editing:

de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 welcome_survey_account_setup_started
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 click {
  "funnel_entry_token": "58aa4123e6790e6b52c2",
  "element_friendly_name": "WelcomeSurvey/AccountSetup save button"
}
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 page_visit {
  "action_source": "internal_referrer",
  "action_context": "{\"user_motivation\":\"editing\"}"
} {
  "agent": {
    "client_platform": "mediawiki_js",
    "client_platform_family": "mobile_browser"
  },
  "page": {
    "namespace_id": -1
  }
}
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 welcome_survey_account_setup_ready {
  "action_context": "{\"ready_ms\":444}"
}
  • "Other" motivation option is recorded as a separate event from "skipped"
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 page_visit {
  "action_source": "internal_referrer",
  "action_context": "{\"user_motivation\":\"other\"}"
} {
  "agent": {
    "client_platform": "mediawiki_js",
    "client_platform_family": "mobile_browser"
  },
  "page": {
    "namespace_id": -1
  }
}
Jdlrobson-WMF reassigned this task from Etonkovidova to HFan-WMF.Fri, Oct 9, 11:04 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits