Maniphest T420750

[ReadingLists] Set up ReadingLists instrument in Test Kitchen
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	LMora-WMF
	Mar 20 2026, 4:14 PM

Project Tags

Referenced Files

None

Subscribers

Description

Background

Set up ReadingList instrument in Test Kitchen referencing instrumentation spec.

Requirements

create instrument in Test Kitchen UI with the following info:
Machine-readable name: reading-list-engagement
Description: For tracking usage trends of ReadingList as a beta feature
OKR: WE3.3
Schema Type: web base
Stream name: product_metrics.web_base
Sample unit: session
Sample rate: 1 (aka 100%)
Contextual attributes:
- agent_client_platform
- agent_client_platform_family
- page_content_language
- page_namespace_id
- mediawiki_skin
- mediawiki_database
- performer_is_logged_in
- performer_is_temp
- performer_is_bot
- performer_edit_count_bucket
- performer_session_id
- performer_id
start/end date: asap and end of next FY
Risk Level: low
wikis: all
document instrument here

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		HFan-WMF	T414368 [Parent task] Transition reading list experimental instrumentation and tracking to permanent
		Resolved		HFan-WMF	T420750 [ReadingLists] Set up ReadingLists instrument in Test Kitchen

Event Timeline

LMora-WMF created this task.Mar 20 2026, 4:14 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 20 2026, 4:14 PM

LMora-WMF triaged this task as High priority.Mar 20 2026, 4:14 PM

LMora-WMF set the point value for this task to 1.

LMora-WMF added a parent task: T414368: [Parent task] Transition reading list experimental instrumentation and tracking to permanent.

LMora-WMF added a project: FY25-26 Reading Lists.Mar 20 2026, 4:17 PM

If we use test kitcken, the Sample unit should be wm-user , not session .

I don't see wm-user as an option in Test Kitchen. https://wikitech.wikimedia.org/wiki/Test_Kitchen/Analytics_sampling#Sample_unit

Sorry for the confusion. To clarify:
For the Analytics_sampling:
Sample_unit: performer_session_id
Sample rate: 100%

~~For Bucketing (Experiment enrollment sampling)~~
~~Sample unit: wm-user~~
Based on the sync-up with LMora, for new instrumentation in text kitchen, we don't need to set it.

Let me know if you have any questions

SToyofuku-WMF added a project: Reader Experience Team.Mar 24 2026, 5:46 PM

SToyofuku-WMF moved this task from Incoming to Ready for sprint on the Reader Experience Team board.

Jdrewniak moved this task from Ready for sprint to REx Sprint 17 [Q3 Mar 24 - Apr 3] on the Reader Experience Team board.Mar 24 2026, 5:49 PM

Jdrewniak edited projects, added: Reader Experience Team (REx Sprint 17 [Q3 Mar 24 - Apr 3]); removed: Reader Experience Team.

LMora-WMF claimed this task.Mar 24 2026, 5:57 PM

LMora-WMF moved this task from Ready to In progress on the Reader Experience Team (REx Sprint 17 [Q3 Mar 24 - Apr 3]) board.

LMora-WMF updated the task description. (Show Details)Mar 24 2026, 6:29 PM

ReadingList Long-term Instrument has be setup on Test Kitchen here.
And Instrument has been added to Test Kitchen Instrument List.

LMora-WMF removed LMora-WMF as the assignee of this task.Mar 24 2026, 6:51 PM

LMora-WMF moved this task from In progress to Needs code review on the Reader Experience Team (REx Sprint 17 [Q3 Mar 24 - Apr 3]) board.

SToyofuku-WMF claimed this task.Mar 24 2026, 6:52 PM

LMora-WMF updated the task description. (Show Details)Mar 24 2026, 7:03 PM

Confirmed everything looks good, thank you!!

SToyofuku-WMF removed SToyofuku-WMF as the assignee of this task.Mar 24 2026, 7:17 PM

SToyofuku-WMF subscribed.

LMora-WMF updated the task description. (Show Details)Mar 26 2026, 6:15 PM

Jdrewniak assigned this task to HFan-WMF.Mar 31 2026, 6:15 PM

Jdrewniak moved this task from Needs QA to Sign-off on the Reader Experience Team (REx Sprint 17 [Q3 Mar 24 - Apr 3]) board.

Not sure what else I need to check for Signing off besides what Steph already checked on in QA, so going to resolve for now :)

[ReadingLists] Set up ReadingLists instrument in Test KitchenClosed, ResolvedPublic1 Estimated Story PointsActions