Page MenuHomePhabricator
Create Task
Maniphest T437339

Recommended reading exp: Instrument user interaction on module
Open, HighPublic5 Estimated Story Points
Actions

Assigned To
Volker_E
Authored By
Volker_E
Sep 8 2026, 6:17 PM
Project Tags
Referenced Files
F107078061: Screenshot 2026-10-08 at 5.23.24 PM.png
Thu, Oct 8, 9:26 PM
F107077427: Screenshot 2026-10-08 at 5.18.43 PM.png
Thu, Oct 8, 9:26 PM
Subscribers
Aklapper
AnneT
Etonkovidova
HFan-WMF
Jdlrobson-WMF
LMora-WMF
Michael
View All 9 Subscribers

Description

Background

Various events will be logged when users interact with the experiment features. Refer to the instrumentation plan to be finalized in T436161.

Requirements

Reader Experience team developers exchanged if event tracking should live in WikimediaEvents (only) or in GrowthExperiments repository. For the short duration of the experiment and to prevent overhead, we decided to mostly go for latter (there's also precedent in Growth team's approach in their DE1.3.1 baseline experiment's instrumentation).

Clarified that everything is handled only behind \GrowthExperiments\FeatureManager::isEarlyOnboardingExperimentTreatment.

Technical

Acceptance Criteria for done

  • All events related to interacting with the recommended reading module feature behind the feature flag in Special:Homepage are instrumented according to the instrumentation plan.

QA

Testing

For test steps consult T436210: Recommended reading exp: Instrumentation data verification.

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
feat(AccountSetup), tests: Add `data-is-interest-based` attribute testVolkerEmediawiki/extensions/GrowthExperimentsmaster+194 -0
EarlyOnboarding: record account setup motivation in `action_context`Michael Großemediawiki/extensions/WikimediaEventswmf/1.47.0-wmf.21+17 -3
Revert "Enable Reading Recommendations experiment on test wiki"VolkerEoperations/mediawiki-configmaster+0 -9
feat(AccountSetup): Instrument reading recommendation clicksVolkerEmediawiki/extensions/GrowthExperimentsmaster+23 -0
EarlyOnboarding: record account setup motivation in `action_context`VolkerEmediawiki/extensions/WikimediaEventsmaster+17 -3
feat(AccountSetup): Remove flag requirement for reading recommendationsVolkerEmediawiki/extensions/GrowthExperimentsmaster+8 -39
EarlyOnboarding: collect referrer on page visit eventsMichael Großemediawiki/extensions/WikimediaEventsmaster+3 -1
instrument(AccountSetup): Instrument reading recommendation clicksVolkerEmediawiki/extensions/WikimediaEventsmaster+124 -0
feat(AccountSetup): Instrument reading recommendation clicksAnne Tomasevichmediawiki/extensions/GrowthExperimentsmaster+26 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Volker_E created this task.Sep 8 2026, 6:17 PM
Volker_E added a parent task: T436161: Recommended Reading exp: Instrumentation Spec (DE 3.2.2).
Volker_E added a subtask: T436210: Recommended reading exp: Instrumentation data verification.
Volker_E mentioned this in T436161: Recommended Reading exp: Instrumentation Spec (DE 3.2.2).Sep 8 2026, 8:23 PM
Volker_E triaged this task as High priority.Sep 9 2026, 7:14 PM
Volker_E raised the priority of this task from High to Needs Triage.
Volker_E moved this task from Backlog / Post-Experiment to Priority II / REx Sprint 6 on the FY26-27 DE 3.2.2 Article recommendations board.Sep 9 2026, 7:59 PM
Jdlrobson-WMF moved this task from Incoming to Backlog on the Reader Experience Team board.Sep 11 2026, 1:44 AM
HFan-WMF edited projects, added: Reader Experience Team (REx Sprint 6 (Q1 FY26-27 Sep 8-21)); removed: Reader Experience Team.Sep 14 2026, 5:23 PM
gerritbot added a comment.Sep 14 2026, 7:30 PM

Change #1341329 had a related patch set uploaded (by Anne Tomasevich; author: Anne Tomasevich):

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup): Instrument reading recommendation clicks

https://gerrit.wikimedia.org/r/1341329

gerritbot added a project: Patch-For-Review.Sep 14 2026, 7:30 PM
HFan-WMF triaged this task as High priority.Sep 15 2026, 1:28 AM
Volker_E moved this task from Ready to In progress on the Reader Experience Team (REx Sprint 6 (Q1 FY26-27 Sep 8-21)) board.Sep 15 2026, 5:53 AM
Volker_E moved this task from In progress to Needs code review on the Reader Experience Team (REx Sprint 6 (Q1 FY26-27 Sep 8-21)) board.
gerritbot added a comment.Sep 15 2026, 10:07 AM

Change #1341721 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup): Instrument reading recommendation clicks

https://gerrit.wikimedia.org/r/1341721

AnneT claimed this task.Sep 15 2026, 5:58 PM
AnneT subscribed.

I think my patch does this according to the instrumentation spec, but the task should be updated with the final info

AnneT removed AnneT as the assignee of this task.Sep 15 2026, 5:58 PM
gerritbot added a comment.Sep 15 2026, 11:24 PM

Change #1342067 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/WikimediaEvents@master] instrument(AccountSetup): Instrument reading recommendation clicks

https://gerrit.wikimedia.org/r/1342067

gerritbot added a comment.Thu, Sep 17, 5:48 PM

Change #1341329 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup): Instrument reading recommendation clicks

https://gerrit.wikimedia.org/r/1341329

ReleaseTaggerBot added a project: MW-1.47-notes (1.47.0-wmf.21; 2026-09-22).Thu, Sep 17, 6:00 PM
AnneT moved this task from Needs code review to Needs QA on the Reader Experience Team (REx Sprint 6 (Q1 FY26-27 Sep 8-21)) board.Thu, Sep 17, 6:32 PM
gerritbot added a comment.Thu, Sep 17, 7:10 PM

Change #1342067 abandoned by VolkerE:

[mediawiki/extensions/WikimediaEvents@master] instrument(AccountSetup): Instrument reading recommendation clicks

Reason:

Reader Experience team has decided to go with instrumentation within GrowthExperiments itself due to short-lived experiment duration to save overhead.

https://gerrit.wikimedia.org/r/1342067

Volker_E moved this task from Needs QA to Sign-off on the Reader Experience Team (REx Sprint 6 (Q1 FY26-27 Sep 8-21)) board.Thu, Sep 17, 7:35 PM
Volker_E moved this task from Sign-off to Needs code review on the Reader Experience Team (REx Sprint 6 (Q1 FY26-27 Sep 8-21)) board.Fri, Sep 18, 5:09 PM
gerritbot added a comment.Fri, Sep 18, 5:22 PM

Change #1343134 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup): Remove flag requirement for reading recommendations

https://gerrit.wikimedia.org/r/1343134

gerritbot added a comment.Fri, Sep 18, 6:48 PM

Change #1343134 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup): Remove flag requirement for reading recommendations

https://gerrit.wikimedia.org/r/1343134

Volker_E updated the task description. (Show Details)Mon, Sep 21, 11:51 AM
Volker_E updated the task description. (Show Details)
gerritbot added a comment.Mon, Sep 21, 11:55 AM

Change #1343200 had a related patch set uploaded (by VolkerE; author: Michael Große):

[mediawiki/extensions/WikimediaEvents@master] EarlyOnboarding: collect referrer on page visit events

https://gerrit.wikimedia.org/r/1343200

gerritbot added a comment.Mon, Sep 21, 12:01 PM

Change #1343200 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] EarlyOnboarding: collect referrer on page visit events

https://gerrit.wikimedia.org/r/1343200

Volker_E updated the task description. (Show Details)Mon, Sep 21, 12:42 PM
gerritbot added a comment.Mon, Sep 21, 2:15 PM

Change #1343560 had a related patch set uploaded (by VolkerE; author: VolkerE):

[operations/mediawiki-config@master] Revert "Enable Reading Recommendations experiment on test wiki"

https://gerrit.wikimedia.org/r/1343560

Jdlrobson-WMF subscribed.Mon, Sep 21, 5:11 PM

https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/1341721 has a merge conflict and is the only remaining patch that needs review.

gerritbot added a comment.Mon, Sep 21, 5:46 PM

Change #1343608 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup): Add `data-is-interest-based` attribute test

https://gerrit.wikimedia.org/r/1343608

Michael edited projects, added: GrowthExperiments-Account-Setup; removed: Home.Tue, Sep 22, 3:15 PM
Michael subscribed.

As I understand it, this is specifically for the upcoming experiment on Special:Homepage, not for the new Special:Home that is still being created and planned to be launched to pliots in November. Adjusting tags accordingly.

HFan-WMF edited projects, added: Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5); removed: Reader Experience Team (REx Sprint 6 (Q1 FY26-27 Sep 8-21)).Tue, Sep 22, 5:52 PM
HFan-WMF moved this task from Ready to In progress on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.
gerritbot added a comment.Wed, Sep 23, 7:13 PM

Change #1344347 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/WikimediaEvents@master] EarlyOnboarding: record account setup motivation in `action_context`

https://gerrit.wikimedia.org/r/1344347

Volker_E moved this task from Priority II / REx Sprint 6 to Priority I / REx Sprint 7 on the FY26-27 DE 3.2.2 Article recommendations board.Wed, Sep 23, 10:05 PM
Volker_E updated the task description. (Show Details)Wed, Sep 23, 10:12 PM
gerritbot added a comment.Thu, Sep 24, 8:09 AM

Change #1344594 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.21] EarlyOnboarding: record account setup motivation in `action_context`

https://gerrit.wikimedia.org/r/1344594

gerritbot added a comment.Thu, Sep 24, 12:26 PM

Change #1344347 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] EarlyOnboarding: record account setup motivation in `action_context`

https://gerrit.wikimedia.org/r/1344347

ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.22; 2026-09-29); removed: MW-1.47-notes (1.47.0-wmf.21; 2026-09-22).Thu, Sep 24, 1:00 PM
Urbanecm_WMF added a project: Growth-Team.Thu, Sep 24, 3:48 PM
Volker_E moved this task from In progress to Needs code review on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.Thu, Sep 24, 4:49 PM
gerritbot added a comment.Thu, Sep 24, 5:12 PM

Change #1341721 abandoned by VolkerE:

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup): Instrument reading recommendation clicks

Reason:

Abandoned for Ib981d9ecae1b14

https://gerrit.wikimedia.org/r/1341721

Volker_E updated the task description. (Show Details)Thu, Sep 24, 9:56 PM
gerritbot added a comment.Thu, Sep 24, 10:01 PM

Change #1343560 merged by jenkins-bot:

[operations/mediawiki-config@master] Revert "Enable Reading Recommendations experiment on test wiki"

https://gerrit.wikimedia.org/r/1343560

Volker_E updated the task description. (Show Details)Thu, Sep 24, 11:16 PM
Volker_E mentioned this in T439217: Make `homepage` (Special:Homepage) identifiable in `page_visit` events.Fri, Sep 25, 8:56 AM
gerritbot added a comment.Mon, Sep 28, 7:44 AM

Change #1344594 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.21] EarlyOnboarding: record account setup motivation in `action_context`

https://gerrit.wikimedia.org/r/1344594

Stashbot mentioned this in T432126: Experiment: DE1.3.1 Early onboarding & account set-up.Mon, Sep 28, 7:44 AM

Mentioned in SAL (#wikimedia-operations) [2026-09-28T07:44:52Z] <mlitn@deploy1003> Started scap sync-world: Backport for [[gerrit:1343611|Growth: Set minimum registration date for A/B test (T432126)]], [[gerrit:1344594|EarlyOnboarding: record account setup motivation in action_context (T437339)]]

Stashbot added a comment.Mon, Sep 28, 7:49 AM

Mentioned in SAL (#wikimedia-operations) [2026-09-28T07:49:09Z] <mlitn@deploy1003> migr, mlitn: Backport for [[gerrit:1343611|Growth: Set minimum registration date for A/B test (T432126)]], [[gerrit:1344594|EarlyOnboarding: record account setup motivation in action_context (T437339)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Mon, Sep 28, 7:59 AM

Mentioned in SAL (#wikimedia-operations) [2026-09-28T07:59:04Z] <mlitn@deploy1003> Finished scap sync-world: Backport for [[gerrit:1343611|Growth: Set minimum registration date for A/B test (T432126)]], [[gerrit:1344594|EarlyOnboarding: record account setup motivation in action_context (T437339)]] (duration: 14m 12s)

ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.21; 2026-09-22); removed: MW-1.47-notes (1.47.0-wmf.22; 2026-09-29).Mon, Sep 28, 8:01 AM
DMburugu moved this task from Inbox to Triaged on the Growth-Team board.Wed, Sep 30, 3:02 PM
Jdlrobson-WMF added a comment.Wed, Sep 30, 7:39 PM

https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/1343608 needs code review.

Jdlrobson-WMF assigned this task to LMora-WMF.Wed, Sep 30, 7:39 PM
LMora-WMF removed LMora-WMF as the assignee of this task.Thu, Oct 1, 2:30 PM
LMora-WMF subscribed.
gerritbot added a comment.Thu, Oct 1, 2:37 PM

Change #1343608 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(AccountSetup), tests: Add `data-is-interest-based` attribute test

https://gerrit.wikimedia.org/r/1343608

Jdlrobson-WMF moved this task from Needs code review to Needs QA on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.Thu, Oct 1, 2:57 PM
ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.23; 2026-10-06); removed: MW-1.47-notes (1.47.0-wmf.21; 2026-09-22).Thu, Oct 1, 3:00 PM
Maintenance_bot removed a project: Patch-For-Review.Thu, Oct 1, 3:32 PM
Jdlrobson-WMF assigned this task to Etonkovidova.Thu, Oct 1, 3:49 PM
Volker_E added a subtask: T439887: Recommended Reading exp: Align Reader pageview metric for control.Thu, Oct 1, 7:30 PM
Jdlrobson-WMF set the point value for this task to 5.Fri, Oct 2, 3:03 PM
HFan-WMF moved this task from Needs QA to Sign-off on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.Tue, Oct 6, 10:42 PM
HFan-WMF moved this task from Sign-off to Needs QA on the Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5) board.
HFan-WMF edited projects, added: Reader Experience Team (REx Sprint 8 (Q2 FY26-27 Oct 6-19)); removed: Reader Experience Team (REx Sprint 7 (Q1 FY26-27 Sep 22-Oct 5).
HFan-WMF moved this task from Ready to Needs QA on the Reader Experience Team (REx Sprint 8 (Q2 FY26-27 Oct 6-19)) board.
Etonkovidova moved this task from Needs QA to Sign-off on the Reader Experience Team (REx Sprint 8 (Q2 FY26-27 Oct 6-19)) board.EditedThu, Oct 8, 9:26 PM

Thank you for excellent instructions in T436210: Recommended reading exp: Instrumentation data verification!

Tested on testwiki wmf.23

  • clicking on a Daily reads recommendation
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 click {
  "action_subtype": "article_link",
  "action_source": "homepage",
  "action_context": "interest_based_recom"
}
`
  • any interaction with the interests selector seems to be not instrumented

Below are the events recorded for the whole account setup

de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 page_visit {
  "action_source": "internal_referrer",
  "action_context": "{}"
} {
  "agent": {
    "client_platform": "mediawiki_js",
    "client_platform_family": "mobile_browser"
  },
  "page": {
    "namespace_id": -1
  }
}
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 impression {
  "element_friendly_name": "WelcomeSurvey/AccountSetup skip button"
}
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 welcome_survey_account_setup_ready {
  "action_context": "{\"ready_ms\":1534}"
}
  • Clicking on "Personalize your Home" button and clicking on "Reading and exploring" on "What's brings you to wikipedia"?

Screenshot 2026-10-08 at 5.18.43 PM.png (792×1,700 px, 116 KB)

de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 welcome_survey_account_setup_started
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 welcome_survey_account_setup_motivation_saved {
  "action_context": "reading"
}
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 impression {
  "element_friendly_name": "WelcomeSurvey/AccountSetup save button"
}
  • selecting three interests and clicking on "Go to your Home" button --> landing on Special:Homepage

Screenshot 2026-10-08 at 5.23.24 PM.png (770×1,708 px, 117 KB)

de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 click {
  "element_friendly_name": "WelcomeSurvey/AccountSetup save button"
}
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 welcome_survey_account_setup_submitted_complete
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 page_visit {
  "action_source": "internal_referrer",
  "action_context": "{\"user_motivation\":\"reading\"}"
} {
  "agent": {
    "client_platform": "mediawiki_js",
    "client_platform_family": "mobile_browser"
  },
  "page": {
    "namespace_id": -1
  }
}
  • clicking on one of the articles in Daily reads
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 click {
  "action_subtype": "article_link",
  "action_source": "homepage",
  "action_context": "interest_based_recom"
}
de-1-3-1-specialhomepage-onboarding-ab-test: The enrollment for this experiment has been overridden. The following event will not be sent:
 page_visit {
  "action_source": "internal_referrer",
  "action_context": "{\"user_motivation\":\"reading\"}"
} {
  "agent": {
    "client_platform": "mediawiki_js",
    "client_platform_family": "mobile_browser"
  },
  "page": {
    "namespace_id": 0
  }
}
Jdlrobson-WMF reassigned this task from Etonkovidova to Volker_E.Fri, Oct 9, 12:20 AM
Jdlrobson-WMF added a subscriber: Etonkovidova.
HFan-WMF closed subtask T439887: Recommended Reading exp: Align Reader pageview metric for control as Resolved.Wed, Oct 14, 3:27 PM
HFan-WMF closed subtask T436210: Recommended reading exp: Instrumentation data verification as Resolved.Wed, Oct 14, 5:54 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits