Reading Lists - XLab configuration
Closed, ResolvedPublic2 Estimated Story Points
Actions

Description

As part of the T397532 reading lists on web experiment, we want to configure the XLab platform with the necessary parameters to run the experiment.

User story

As a product team, want to make data driven decisions by running experiments.

Requirements

This experiment should only run on logged-in users, per the conditions outlined in T402231.

Per the Instrumentation spec, the experiment should be configured as such

schema

analytics/product_metrics/web/base

stream name

mediawiki.product_metrics.reading_list

experiment info

Machine readable experiment name:
we-3-3-4-reading-list-test1

Machine readable group names:
- control
- treatment

experiment.subject_id

contextual attributes

- agent_client_platform
- agent_client_platform_family
- page_content_language
- page_namespace_id
- mediawiki_skin
- mediawiki.database
- performer.is_logged_in
- performer.is_temp
- performer.is_bot
- performer.edit_count_bucket
- performer.session_id

Acceptance criteria

An xlab configuration for this specific experiment exists.

BDD

For QA engineer to fill out.

Test Steps

For QA engineer to fill out.

Communication criteria

Add if this needs an announcement or discussion.

Rollback plan

Describe the rollback plan in production for this task if something goes wrong.

This task was created by Version 1.0.0 of the Reader Experience team task template using phabulous.

Related Objects

Mentioned In: T402314: [SPIKE] Reading Lists - Total saved articles (PHP) instrumentation
Mentioned Here: T397532: [Hypothesis] FY2025-26 WE 3.3.4 Reading Lists on web
T402231: [Reading Lists] Create hidden user preference to scope Reading Lists web UI to specific logged-in users

Event Timeline

Jdrewniak created this task.Aug 19 2025, 4:13 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 19 2025, 4:13 PM

Jdrewniak triaged this task as High priority.Aug 19 2025, 4:13 PM

Jdrewniak moved this task from Incoming to Needs refinement on the Reader Experience Team board.

Jdrewniak updated the task description. (Show Details)Aug 20 2025, 2:55 PM

Jdrewniak set the point value for this task to 2.Aug 20 2025, 5:12 PM

Jdlrobson-WMF moved this task from Needs refinement to Ready for sprint on the Reader Experience Team board.Aug 20 2025, 5:12 PM

For this task, do we need to add a new event stream?

https://gerrit.wikimedia.org/r/plugins/gitiles/operations/mediawiki-config/+/refs/heads/master/wmf-config/ext-EventStreamConfig.php

The main differences between the reading_list event stream and product_metrics.web_base are that we include edit count and session_id.

aude mentioned this in T402314: [SPIKE] Reading Lists - Total saved articles (PHP) instrumentation.Aug 21 2025, 6:59 PM

We definitely don't need an event stream for the xlab configuration itself - my understanding is that streams and schemas are now handled by the experiments platform, and we now pass in the contextual attributes we want to the event logging method, but I could be wrong about this

Just noting that in this patch we commented out the instrumentation code to not load it unnecessarily, and that after the experiment is configured (in this task) we should remove that comment in order to test the instrumentation.

HFan-WMF moved this task from Incoming to Phase 1 (Desktop reading list A/B experiment) on the FY25-26 WE3.3.4/3.8.2 Reading List Experiment & Rollout board.Oct 15 2025, 4:46 PM

SToyofuku-WMF moved this task from Ready for sprint to REx Sprint 8 [Q2 Oct 21-Nov 3] on the Reader Experience Team board.Oct 21 2025, 5:38 PM

SToyofuku-WMF edited projects, added Reader Experience Team (REx Sprint 8 [Q2 Oct 21-Nov 3]); removed Reader Experience Team.

Jdrewniak moved this task from REx Sprint 8 [Q2 Oct 21-Nov 3] to REx Sprint 9 [Q2 Nov 4 - Nov 17] on the Reader Experience Team board.Nov 4 2025, 6:15 PM

Jdrewniak edited projects, added Reader Experience Team (REx Sprint 9 [Q2 Nov 4 - Nov 17]); removed Reader Experience Team (REx Sprint 8 [Q2 Oct 21-Nov 3]).

Jdrewniak moved this task from Ready to Needs QA on the Reader Experience Team (REx Sprint 9 [Q2 Nov 4 - Nov 17]) board.Nov 4 2025, 6:22 PM

SToyofuku-WMF moved this task from Needs QA to Ready on the Reader Experience Team (REx Sprint 9 [Q2 Nov 4 - Nov 17]) board.Nov 4 2025, 6:22 PM

Commented out instrumentation code has been removed, so we're good to go on that end.

LMora-WMF claimed this task.Nov 5 2025, 4:16 PM

LMora-WMF moved this task from Ready to In progress on the Reader Experience Team (REx Sprint 9 [Q2 Nov 4 - Nov 17]) board.

LMora-WMF updated the task description. (Show Details)Nov 5 2025, 4:34 PM

Configuration here: https://mpic.wikimedia.org/experiment/we-3-3-4-reading-list-test1

LMora-WMF moved this task from In progress to Needs code review on the Reader Experience Team (REx Sprint 9 [Q2 Nov 4 - Nov 17]) board.Nov 6 2025, 3:57 PM

Updated the phab ticket, but looks good to me - idk who should do QA, but ideally this would get looked at by at least one more person before we sign it off

Hsuanwei to sign off

HFan-WMF reassigned this task from HFan-WMF to Jdrewniak.Nov 14 2025, 7:11 PM

HFan-WMF subscribed.

HFan-WMF closed this task as Resolved.Nov 18 2025, 9:54 PM

Reading Lists - XLab configurationClosed, ResolvedPublic2 Estimated Story PointsActions