Prod data QA for Mobile TOC
Closed, ResolvedPublic3 Estimated Story Points
Actions

Assigned To

Authored By

	SherryYang-WMF
	Jan 30 2026, 11:24 PM

Description

Instrumentation has been implemented in Test Kitchen tickets.

Acceptance criteria

check that all events are collected in the Data Lake at Test Kitchen
check that all events are streamed on Kafka

instrumentation [spec] https://phabricator.wikimedia.org/T415611

Details

Other Assignee: mfossati

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T415948 [EPIC] Minerva TOC
		Resolved		KSarabia-WMF	T416051 Prod data QA for Mobile TOC

Event Timeline

SherryYang-WMF created this task.Jan 30 2026, 11:24 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 30 2026, 11:24 PM

SherryYang-WMF triaged this task as Unbreak Now! priority.Jan 30 2026, 11:25 PM

SherryYang-WMF lowered the priority of this task from Unbreak Now! to High.

SherryYang-WMF updated the task description. (Show Details)

SherryYang-WMF moved this task from Ready to Sprint 2 (Feb 3 - 16) Q3 25/26 on the Reader Growth Team board.Jan 31 2026, 12:25 AM

SherryYang-WMF edited projects, added Reader Growth Team (Sprint 2 (Feb 3 - 16) Q3 25/26); removed Reader Growth Team.

SherryYang-WMF moved this task from Sprint 2 (Feb 3 - 16) Q3 25/26 to Backlog on the Reader Growth Team board.Feb 4 2026, 6:08 PM

SherryYang-WMF edited projects, added Reader Growth Team; removed Reader Growth Team (Sprint 2 (Feb 3 - 16) Q3 25/26).

egardner added a project: ReaderExperiments-MinervaTOC.Feb 10 2026, 10:32 PM

SherryYang-WMF moved this task from Backlog to Sprint 2 (Feb 3 - 16) Q3 25/26 on the Reader Growth Team board.Feb 11 2026, 10:56 PM

SherryYang-WMF edited projects, added Reader Growth Team (Sprint 2 (Feb 3 - 16) Q3 25/26); removed Reader Growth Team.

Refer to notebook to repro the same queries

SherryYang-WMF reassigned this task from jwang to KSarabia-WMF.Feb 11 2026, 11:04 PM

SherryYang-WMF updated Other Assignee, added: jwang.

SherryYang-WMF added a subscriber: jwang.

lwatson added a parent task: T415948: [EPIC] Minerva TOC.Feb 11 2026, 11:51 PM

lwatson updated the task description. (Show Details)

SherryYang-WMF moved this task from Sprint 2 (Feb 3 - 16) Q3 25/26 to Sprint 3 (Feb 17 - Mar 2) Q3 25/26 on the Reader Growth Team board.Tue, Feb 17, 5:17 PM

SherryYang-WMF edited projects, added Reader Growth Team (Sprint 3 (Feb 17 - Mar 2) Q3 25/26); removed Reader Growth Team (Sprint 2 (Feb 3 - 16) Q3 25/26).

SherryYang-WMF set the point value for this task to 2.Tue, Feb 17, 6:32 PM

SherryYang-WMF changed the point value for this task from 2 to 3.

KSarabia-WMF moved this task from Committed to Doing on the Reader Growth Team (Sprint 3 (Feb 17 - Mar 2) Q3 25/26) board.Wed, Feb 25, 5:07 PM

mfossati updated the task description. (Show Details)Thu, Feb 26, 10:34 AM

Kafka events

Instrumentation spec: https://docs.google.com/spreadsheets/d/11zMRr-CDJzpdzxhunk8k7hw7rNfg6D8IZazVLZHpP5g/edit?gid=0#gid=0

mfossati@stat1009:~$ kafkacat -C -b kafka-jumbo1016.eqiad.wmnet:9092 -t eqiad.mediawiki.product_metrics.reader_experiments -o -1000 -e | jq '.'

page-visited ✅
treatment-ui-loaded ✅
click toc_icon ✅
click topic_link ✅
init_toc ✅
tick ✅

Superset results here
Data is from events fired on 2/25/26 and 2/26/26

HSwan-WMF moved this task from QA to Signoff on the Reader Growth Team (Sprint 3 (Feb 17 - Mar 2) Q3 25/26) board.Mon, Mar 2, 5:14 PM

SherryYang-WMF closed this task as Resolved.Mon, Mar 2, 11:03 PM

Prod data QA for Mobile TOCClosed, ResolvedPublic3 Estimated Story PointsActions